JUnit version 4.13.2
.14:21:55.321 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114115314
14:21:55.343 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114115343
14:21:55.372 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:21:55.376 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:21:55.430 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:21:55.439 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:21:55.443 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:21:55.445 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:21:55.610 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:21:55.809 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:21:55.810 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:21:55.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:55.813723  9758 mini_oidc.cc:150] Starting JWKS server
14:21:55.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:55.817231  9758 webserver.cc:533] Webserver started at http://127.0.0.1:33465/ using document root <none> and password file <none>
14:21:55.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:55.817718  9758 mini_oidc.cc:186] Starting OIDC Discovery server
14:21:55.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:55.819711  9758 webserver.cc:533] Webserver started at http://127.0.0.1:35467/ using document root <none> and password file <none>
14:21:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:21:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:21:55.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:21:55Z Disabled control of system clock
14:21:55.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:55.876155  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:55.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:55.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:55.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:55.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/logs
14:21:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data/info.pb
14:21:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:55.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:55.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:55.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:55.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:55.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:55.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:55.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:55.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:55.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.190:41023
14:21:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.190
14:21:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json with env {}
14:21:56.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.166927  9770 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:21:56.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.167657  9770 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:21:56.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.168411  9770 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:21:56.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.198807  9770 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:21:56.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.199137  9770 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:21:56.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.199473  9770 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:21:56.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.199822  9770 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:21:56.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.200166  9770 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:21:56.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.200479  9770 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33465/jwks.json
14:21:56.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.234241  9770 master_runner.cc:387] Master server non-default flags:
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.190:41023
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:56.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:21:56.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:56.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json
14:21:56.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data/info.pb
14:21:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.190
14:21:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:21:56.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:56.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:21:56.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:21:56.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/logs
14:21:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:21:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:21:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:21:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:21:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:21:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:21:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:21:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:21:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:21:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.236019  9770 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:21:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.238292  9770 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:21:56.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.250732  9776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.251570  9777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.434056  9779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.437477  9778 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1184 milliseconds
14:21:57.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.438441  9770 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.187s	user 0.388s	sys 0.795s
14:21:57.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.438827  9770 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.188s	user 0.388s	sys 0.795s
14:21:57.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.439147  9770 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:21:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.440848  9770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:21:57.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.444528  9770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:21:57.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.446307  9770 hybrid_clock.cc:648] HybridClock initialized: now 1779114117446277 us; error 122 us; skew 500 ppm
14:21:57.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.447760  9770 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:21:57.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.458571  9770 webserver.cc:533] Webserver started at http://127.9.135.190:37189/ using document root <none> and password file <none>
14:21:57.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.459985  9770 fs_manager.cc:362] Metadata directory not provided
14:21:57.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.460328  9770 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:21:57.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.460937  9770 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:21:57.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.468173  9770 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data/instance:
14:21:57.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f6c3750c5bf41b29eae4971c56904e1"
14:21:57.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-1n46"
14:21:57.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.469671  9770 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal/instance:
14:21:57.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f6c3750c5bf41b29eae4971c56904e1"
14:21:57.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-1n46"
14:21:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.479338  9770 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.002s	sys 0.006s
14:21:57.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.486903  9786 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:21:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.488176  9770 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
14:21:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.488547  9770 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal
14:21:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f6c3750c5bf41b29eae4971c56904e1"
14:21:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-1n46"
14:21:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.489424  9770 fs_report.cc:389] FS layout report
14:21:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:21:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal
14:21:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data/data
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:21:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:21:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:21:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:21:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:21:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:21:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:21:57.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.562985  9770 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:21:57.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.564172  9770 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:21:57.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.564497  9770 kserver.cc:163] Server-wide thread pool size limit: 3276
14:21:57.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.630757  9770 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.190:41023
14:21:57.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.630848  9837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.190:41023 every 8 connection(s)
14:21:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.633498  9770 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/data/info.pb
14:21:57.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.637292  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 9770
14:21:57.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.637764  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-0/wal/instance
14:21:57.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.641331  9838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:21:57.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.642552  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/logs
14:21:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data/info.pb
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.189:37257
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.189
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:57.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json with env {}
14:21:57.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.653302  9838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } has no permanent_uuid. Determining permanent_uuid...
14:21:57.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.676034  9838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } has no permanent_uuid. Determining permanent_uuid...
14:21:57.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.678197  9788 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.681831  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:57.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.731350  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 1
14:21:57.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.735543  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:57.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.803957  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 2
14:21:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.807979  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:57.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.899317  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 3
14:21:57.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.903072  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:57.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.930243  9840 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:21:57.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.930750  9840 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:21:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.931171  9840 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:21:57.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.960515  9840 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:21:57.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.960870  9840 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:21:57.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.961179  9840 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:21:57.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.961506  9840 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:21:57.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.961849  9840 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:21:57.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.962123  9840 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33465/jwks.json
14:21:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.994871  9840 master_runner.cc:387] Master server non-default flags:
14:21:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.189:37257
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:21:57.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json
14:21:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data/info.pb
14:21:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.189
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:57.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/logs
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:21:58.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.996512  9840 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:21:58.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.998662  9840 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:21:58.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.010411  9849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:58.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.046502  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 4
14:21:58.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.054313  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:58.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.353837  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 5
14:21:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.361909  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:58.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.909515  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 6
14:21:58.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.938460  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.189:37257: Network error: Client connection negotiation failed: client connection to 127.9.135.189:37257: connect: Connection refused (error 111)
14:21:59.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.010886  9850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:59.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.317471  9851 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1305 milliseconds
14:21:59.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.317857  9852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:59.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.322319  9840 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.312s	user 0.437s	sys 0.864s
14:21:59.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.322597  9840 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.312s	user 0.437s	sys 0.864s
14:21:59.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.322901  9840 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:21:59.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.324110  9840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:21:59.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.326927  9840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:21:59.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.328641  9840 hybrid_clock.cc:648] HybridClock initialized: now 1779114119328572 us; error 74 us; skew 500 ppm
14:21:59.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.329502  9840 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:21:59.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.336654  9840 webserver.cc:533] Webserver started at http://127.9.135.189:39237/ using document root <none> and password file <none>
14:21:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.338227  9840 fs_manager.cc:362] Metadata directory not provided
14:21:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.338485  9840 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:21:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.339349  9840 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:21:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.343375  9840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data/instance:
14:21:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc25496835f842ae807a58186502d3d3"
14:21:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-1n46"
14:21:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.344610  9840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal/instance:
14:21:59.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc25496835f842ae807a58186502d3d3"
14:21:59.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-1n46"
14:21:59.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.351675  9840 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
14:21:59.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.357664  9861 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:21:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.358799  9840 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:21:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.359139  9840 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal
14:21:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc25496835f842ae807a58186502d3d3"
14:21:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-1n46"
14:21:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.359525  9840 fs_report.cc:389] FS layout report
14:21:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:21:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal
14:21:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal
14:21:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data/data
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:21:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:21:59.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:21:59.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:21:59.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:21:59.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:21:59.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.442260  9840 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:21:59.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.443630  9840 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:21:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.444065  9840 kserver.cc:163] Server-wide thread pool size limit: 3276
14:21:59.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.508386  9840 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.189:37257
14:21:59.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.508460  9912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.189:37257 every 8 connection(s)
14:21:59.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.511216  9840 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/data/info.pb
14:21:59.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.516685  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:21:59.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.520025  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 9840
14:21:59.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.520448  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-1/wal/instance
14:21:59.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.523330  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:59.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:21:59.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/logs
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data/info.pb
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:59.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.188:36123
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.188
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:59.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:59.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:59.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:59.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json with env {}
14:21:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.530591  9913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.554127  9913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.566706  9913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.568953  9864 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:21:59.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.573920  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:21:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.623418  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 1
14:21:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.626987  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:21:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.695405  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 2
14:21:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.699177  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:21:59.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.790542  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 3
14:21:59.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.794341  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:21:59.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.824194  9915 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:21:59.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.824673  9915 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:21:59.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.825086  9915 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:21:59.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.854332  9915 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:21:59.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.854578  9915 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:21:59.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.854768  9915 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:21:59.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.854946  9915 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:21:59.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.855145  9915 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:21:59.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.855351  9915 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33465/jwks.json
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.892484  9915 master_runner.cc:387] Master server non-default flags:
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:21:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.188:36123
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33465/jwks.json
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data/info.pb
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.188
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/logs
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:21:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.893709  9915 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:21:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.895318  9915 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:21:59.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.906241  9925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:59.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.937781  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 4
14:21:59.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.944782  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.998996  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } attempt: 7
14:22:00.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.029884  9838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } has no permanent_uuid. Determining permanent_uuid...
14:22:00.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.049609  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.108114  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 1
14:22:00.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.115037  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.196561  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 2
14:22:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.203737  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.244284  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 5
14:22:00.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.254372  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.289218  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 3
14:22:00.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.296324  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.436851  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 4
14:22:00.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.444067  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.727557  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 5
14:22:00.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.734449  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:00.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.801908  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 6
14:22:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.828284  9913 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:01.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.286960  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 6
14:22:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.325791  9838 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.135.188:36123: Network error: Client connection negotiation failed: client connection to 127.9.135.188:36123: connect: Connection refused (error 111)
14:22:01.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.313943  9924 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 9915
14:22:01.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.616816  9915 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.710s	user 0.587s	sys 1.119s
14:22:01.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.617223  9915 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.711s	user 0.588s	sys 1.119s
14:22:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.906997  9926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.618503  9927 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1710 milliseconds
14:22:01.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.619669  9928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:01.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.619717  9915 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:01.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.622740  9915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:01.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.624804  9915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.626076  9915 hybrid_clock.cc:648] HybridClock initialized: now 1779114121626045 us; error 49 us; skew 500 ppm
14:22:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.626820  9915 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:01.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.632740  9915 webserver.cc:533] Webserver started at http://127.9.135.188:37075/ using document root <none> and password file <none>
14:22:01.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.633527  9915 fs_manager.cc:362] Metadata directory not provided
14:22:01.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.633689  9915 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:01.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.634135  9915 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:01.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.639727  9915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data/instance:
14:22:01.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b73e320c75464418acb3ba42e5cd4b98"
14:22:01.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-1n46"
14:22:01.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.640658  9915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal/instance:
14:22:01.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b73e320c75464418acb3ba42e5cd4b98"
14:22:01.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-1n46"
14:22:01.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.648404  9915 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
14:22:01.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.653139  9941 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:01.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.654273  9915 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
14:22:01.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.654541  9915 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal
14:22:01.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b73e320c75464418acb3ba42e5cd4b98"
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-1n46"
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.654810  9915 fs_report.cc:389] FS layout report
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data/data
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:01.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:01.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:01.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.704936  9915 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:01.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.706310  9915 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:01.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.706725  9915 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:01.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.771337  9915 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.188:36123
14:22:01.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.771401  9992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.188:36123 every 8 connection(s)
14:22:01.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.773808  9915 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/data/info.pb
14:22:01.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.775321  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 9915
14:22:01.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.775796  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/master-2/wal/instance
14:22:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.780846  9993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:01.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.796216  9993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.824159  9993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.833117  9993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.850047  9993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: Bootstrap starting.
14:22:01.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.856236  9993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: Neither blocks nor log segments found. Creating new log.
14:22:01.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.858081  9993 log.cc:826] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: Log is configured to *not* fsync() on all Append() calls
14:22:01.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.861686  9993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: No bootstrap required, opened a new log
14:22:01.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.879540  9993 raft_consensus.cc:359] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:01.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.880141  9993 raft_consensus.cc:385] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:01.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.880390  9993 raft_consensus.cc:740] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b73e320c75464418acb3ba42e5cd4b98, State: Initialized, Role: FOLLOWER
14:22:01.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.881206  9993 consensus_queue.cc:260] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:01.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.883268 10002 sys_catalog.cc:455] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:01.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.884109 10002 sys_catalog.cc:458] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: This master's current role is: FOLLOWER
14:22:01.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.885205  9993 sys_catalog.cc:565] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: configured and running, proceeding with master startup.
14:22:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.888813  9913 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 7
14:22:01.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.905954  9913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: Bootstrap starting.
14:22:01.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.913246  9913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: Neither blocks nor log segments found. Creating new log.
14:22:01.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.915573  9913 log.cc:826] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: Log is configured to *not* fsync() on all Append() calls
14:22:01.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.918095 10014 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:01.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.918694 10014 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.922482  9913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: No bootstrap required, opened a new log
14:22:01.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.909857  9915 master_runner.cc:187] Error getting master registration for 127.9.135.190:41023: OK, instance_id { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" instance_seqno: 1779114117611979 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:01.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.935645  9915 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.948817  9913 raft_consensus.cc:359] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:01.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.949625  9913 raft_consensus.cc:385] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:01.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.949935  9913 raft_consensus.cc:740] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25496835f842ae807a58186502d3d3, State: Initialized, Role: FOLLOWER
14:22:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.950804  9913 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:01.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.953401 10017 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:01.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.955559 10017 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: This master's current role is: FOLLOWER
14:22:01.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.955171  9913 sys_catalog.cc:565] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: configured and running, proceeding with master startup.
14:22:01.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.961500  9947 tablet.cc:2404] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:01.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.992174 10028 catalog_manager.cc:1594] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:01.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.992937 10028 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:02.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.987294  9840 master_runner.cc:187] Error getting master registration for 127.9.135.190:41023: OK, instance_id { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" instance_seqno: 1779114117611979 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:02.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.009932  9840 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:02.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:02.201088  9867 tablet.cc:2404] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:02.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.300756 10002 raft_consensus.cc:493] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:02.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.301265 10002 raft_consensus.cc:515] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.303563 10002 leader_election.cc:290] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6c3750c5bf41b29eae4971c56904e1 (127.9.135.190:41023), cc25496835f842ae807a58186502d3d3 (127.9.135.189:37257)
14:22:02.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.306825  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b73e320c75464418acb3ba42e5cd4b98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25496835f842ae807a58186502d3d3" is_pre_election: true
14:22:02.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.307672  9888 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b73e320c75464418acb3ba42e5cd4b98 in term 0.
14:22:02.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.309542  9943 leader_election.cc:304] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b73e320c75464418acb3ba42e5cd4b98, cc25496835f842ae807a58186502d3d3; no voters: 
14:22:02.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.310763 10002 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:02.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.311069 10002 raft_consensus.cc:493] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:02.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.311353 10002 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 0 FOLLOWER]: Advancing to term 1
14:22:02.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.322832 10002 raft_consensus.cc:515] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:02.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.325623 10002 leader_election.cc:290] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6c3750c5bf41b29eae4971c56904e1 (127.9.135.190:41023), cc25496835f842ae807a58186502d3d3 (127.9.135.189:37257)
14:22:02.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.327754  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b73e320c75464418acb3ba42e5cd4b98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25496835f842ae807a58186502d3d3"
14:22:02.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.328310  9888 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 0 FOLLOWER]: Advancing to term 1
14:22:02.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.335280  9888 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b73e320c75464418acb3ba42e5cd4b98 in term 1.
14:22:02.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.336642  9943 leader_election.cc:304] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b73e320c75464418acb3ba42e5cd4b98, cc25496835f842ae807a58186502d3d3; no voters: 
14:22:02.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.337368 10002 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 1 FOLLOWER]: Leader election won for term 1
14:22:02.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.348366 10002 raft_consensus.cc:697] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [term 1 LEADER]: Becoming Leader. State: Replica: b73e320c75464418acb3ba42e5cd4b98, State: Running, Role: LEADER
14:22:02.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.349480 10002 consensus_queue.cc:237] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:02.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.355881 10030 sys_catalog.cc:455] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b73e320c75464418acb3ba42e5cd4b98. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.356715 10030 sys_catalog.cc:458] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: This master's current role is: LEADER
14:22:02.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.359313  9838 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } attempt: 7
14:22:02.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.391791 10032 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:22:02.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.405117  9838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: Bootstrap starting.
14:22:02.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.412593  9838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: Neither blocks nor log segments found. Creating new log.
14:22:02.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.414821  9838 log.cc:826] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: Log is configured to *not* fsync() on all Append() calls
14:22:02.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.421537 10032 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:22:02.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.429324  9838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: No bootstrap required, opened a new log
14:22:02.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.448808  9888 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [term 1 FOLLOWER]: Refusing update from remote peer b73e320c75464418acb3ba42e5cd4b98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:02.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.452960 10002 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.466116  9838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:02.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.467159  9838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:02.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.467799  9838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6c3750c5bf41b29eae4971c56904e1, State: Initialized, Role: FOLLOWER
14:22:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.468920  9838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } }
14:22:02.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.482939 10037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.483644 10037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.485073  9838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: configured and running, proceeding with master startup.
14:22:02.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.485273  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b73e320c75464418acb3ba42e5cd4b98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6c3750c5bf41b29eae4971c56904e1"
14:22:02.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.486173  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b73e320c75464418acb3ba42e5cd4b98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6c3750c5bf41b29eae4971c56904e1" is_pre_election: true
14:22:02.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.489118  9812 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 0 FOLLOWER]: Advancing to term 1
14:22:02.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.502197  9812 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b73e320c75464418acb3ba42e5cd4b98 in term 1.
14:22:02.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.503706  9811 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [term 1 FOLLOWER]: Refusing update from remote peer b73e320c75464418acb3ba42e5cd4b98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:02.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.508599 10002 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:02.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.542325 10035 mvcc.cc:204] Tried to move back new op lower bound from 7287251445533995008 to 7287251445152075776. Current Snapshot: MvccSnapshot[applied={T|T < 7287251445533995008}]
14:22:02.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.541267 10037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b73e320c75464418acb3ba42e5cd4b98. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.542975 10037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.547367 10002 sys_catalog.cc:455] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.548321 10002 sys_catalog.cc:458] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: This master's current role is: LEADER
14:22:02.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.552958 10040 mvcc.cc:204] Tried to move back new op lower bound from 7287251445533995008 to 7287251445152075776. Current Snapshot: MvccSnapshot[applied={T|T < 7287251445533995008}]
14:22:02.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.558591 10032 catalog_manager.cc:1383] Generated new cluster ID: b88ffe5e5aa547349dd9eed5b2e3ef14
14:22:02.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.558182 10037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.558853 10032 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:22:02.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.558856 10037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.566372 10036 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b73e320c75464418acb3ba42e5cd4b98. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.571547 10036 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.574110 10002 sys_catalog.cc:455] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.574774 10002 sys_catalog.cc:458] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98 [sys.catalog]: This master's current role is: LEADER
14:22:02.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.579533 10036 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b73e320c75464418acb3ba42e5cd4b98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6c3750c5bf41b29eae4971c56904e1" member_type: VOTER last_known_addr { host: "127.9.135.190" port: 41023 } } peers { permanent_uuid: "cc25496835f842ae807a58186502d3d3" member_type: VOTER last_known_addr { host: "127.9.135.189" port: 37257 } } peers { permanent_uuid: "b73e320c75464418acb3ba42e5cd4b98" member_type: VOTER last_known_addr { host: "127.9.135.188" port: 36123 } } }
14:22:02.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.580096 10036 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.600400 10055 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:22:02.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.606549 10032 catalog_manager.cc:1406] Generated new certificate authority record
14:22:02.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.608317 10032 catalog_manager.cc:1540] Loading token signing keys...
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.646438 10032 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b73e320c75464418acb3ba42e5cd4b98: Generated new TSK 0
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.647761 10032 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:22:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.669061  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal
14:22:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data
14:22:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/logs
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data/info.pb
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.129:0
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.129
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.129
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:02.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.998654 10028 catalog_manager.cc:1295] Loaded cluster ID: b88ffe5e5aa547349dd9eed5b2e3ef14
14:22:02.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.999414 10028 catalog_manager.cc:1588] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: loading cluster ID for follower catalog manager: success
14:22:03.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.005894 10028 catalog_manager.cc:1610] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: acquiring CA information for follower catalog manager: success
14:22:03.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.011368 10028 catalog_manager.cc:1638] T 00000000000000000000000000000000 P cc25496835f842ae807a58186502d3d3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:03.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.118958 10056 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:03.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.119513 10056 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:03.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.120119 10056 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:03.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.174525 10056 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:03.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.176435 10056 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.135.129
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.238474 10056 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.129:0
14:22:03.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data/info.pb
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.129
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.129
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/logs
14:22:03.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.240046 10056 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:03.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.243625 10056 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.259161 10063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:03.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.631732 10055 catalog_manager.cc:1295] Loaded cluster ID: b88ffe5e5aa547349dd9eed5b2e3ef14
14:22:03.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.631965 10055 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: loading cluster ID for follower catalog manager: success
14:22:03.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.642360 10055 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: acquiring CA information for follower catalog manager: success
14:22:03.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.647014 10055 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 6f6c3750c5bf41b29eae4971c56904e1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:05.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:04.662269 10062 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 10056
14:22:05.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.126858 10056 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.850s	user 0.000s	sys 0.003s
14:22:05.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.130383 10056 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.854s	user 0.000s	sys 0.004s
14:22:05.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.130720 10067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:05.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.261845 10064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.134778 10065 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1867 milliseconds
14:22:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.134861 10056 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:05.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.136660 10056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:05.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.150645 10056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:05.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.152302 10056 hybrid_clock.cc:648] HybridClock initialized: now 1779114125152260 us; error 55 us; skew 500 ppm
14:22:05.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.153568 10056 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.172780 10056 webserver.cc:533] Webserver started at http://127.9.135.129:46475/ using document root <none> and password file <none>
14:22:05.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.174564 10056 fs_manager.cc:362] Metadata directory not provided
14:22:05.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.175097 10056 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:05.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.175899 10056 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:05.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.182365 10056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data/instance:
14:22:05.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3c968dd33116421ebd3ac5c09bb77731"
14:22:05.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:05 on dist-test-slave-1n46"
14:22:05.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.184122 10056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal/instance:
14:22:05.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3c968dd33116421ebd3ac5c09bb77731"
14:22:05.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:05 on dist-test-slave-1n46"
14:22:05.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.199201 10056 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.008s	sys 0.004s
14:22:05.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.212181 10074 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:05.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.213693 10056 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.002s	sys 0.008s
14:22:05.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.214341 10056 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal
14:22:05.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3c968dd33116421ebd3ac5c09bb77731"
14:22:05.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:05 on dist-test-slave-1n46"
14:22:05.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.215159 10056 fs_report.cc:389] FS layout report
14:22:05.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data/data
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:05.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.300388 10056 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:05.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.302347 10056 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:05.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.302914 10056 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:05.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.306443 10056 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:05.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.312188 10056 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:05.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.312454 10056 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:05.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.312734 10056 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:05.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.312940 10056 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:05.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.493659 10056 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.129:36655
14:22:05.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.493818 10186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.129:36655 every 8 connection(s)
14:22:05.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.497736 10056 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/data/info.pb
14:22:05.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.506634  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10056
14:22:05.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.507054  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-0/wal/instance
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.520939  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:05.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/logs
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data/info.pb
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.130:0
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.130
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.130
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:05.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:05.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.590539 10194 heartbeater.cc:344] Connected to a master server at 127.9.135.190:41023
14:22:05.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.591015 10194 heartbeater.cc:461] Registering TS with master...
14:22:05.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.592233 10194 heartbeater.cc:507] Master 127.9.135.190:41023 requested a full tablet report, sending...
14:22:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.595984  9803 ts_manager.cc:194] Registered new tserver with Master: 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655)
14:22:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.596236 10187 heartbeater.cc:344] Connected to a master server at 127.9.135.188:36123
14:22:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.596565 10187 heartbeater.cc:461] Registering TS with master...
14:22:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.597429 10187 heartbeater.cc:507] Master 127.9.135.188:36123 requested a full tablet report, sending...
14:22:05.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.600055  9958 ts_manager.cc:194] Registered new tserver with Master: 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655)
14:22:05.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.603600 10188 heartbeater.cc:344] Connected to a master server at 127.9.135.189:37257
14:22:05.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.603926 10188 heartbeater.cc:461] Registering TS with master...
14:22:05.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.604671 10188 heartbeater.cc:507] Master 127.9.135.189:37257 requested a full tablet report, sending...
14:22:05.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.607242  9878 ts_manager.cc:194] Registered new tserver with Master: 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655)
14:22:05.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:05.608958  9958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.135.129:55089
14:22:05.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.952247 10191 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:05.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.952656 10191 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:05.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.953027 10191 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.984058 10191 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:05.984762 10191 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.135.130
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.018945 10191 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal
14:22:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.130:0
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data/info.pb
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.130
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:06.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.130
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/logs
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.020205 10191 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.022250 10191 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:06.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.035858 10204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:06.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.614475 10187 heartbeater.cc:499] Master 127.9.135.188:36123 was elected leader, sending a full tablet report...
14:22:07.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.037539 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:07.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.438858 10203 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 10191
14:22:07.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.498199 10191 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.461s	user 0.423s	sys 0.934s
14:22:07.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.499161 10191 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.463s	user 0.424s	sys 0.934s
14:22:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.505698 10206 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1461 milliseconds
14:22:07.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.506906 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:07.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.506955 10191 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:07.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.508399 10191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:07.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.510772 10191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.512112 10191 hybrid_clock.cc:648] HybridClock initialized: now 1779114127512072 us; error 39 us; skew 500 ppm
14:22:07.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.512933 10191 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:07.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.520103 10191 webserver.cc:533] Webserver started at http://127.9.135.130:41487/ using document root <none> and password file <none>
14:22:07.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.521062 10191 fs_manager.cc:362] Metadata directory not provided
14:22:07.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.521308 10191 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:07.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.521818 10191 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:07.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.525693 10191 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data/instance:
14:22:07.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b87306fca0b04ad6ba2642cf571feb46"
14:22:07.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:07 on dist-test-slave-1n46"
14:22:07.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.526680 10191 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal/instance:
14:22:07.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b87306fca0b04ad6ba2642cf571feb46"
14:22:07.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:07 on dist-test-slave-1n46"
14:22:07.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.533097 10191 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
14:22:07.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.538388 10215 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:07.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.539592 10191 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.539942 10191 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b87306fca0b04ad6ba2642cf571feb46"
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:07 on dist-test-slave-1n46"
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.540246 10191 fs_report.cc:389] FS layout report
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal
14:22:07.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data/data
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.583608 10191 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.584827 10191 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.585170 10191 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:07.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.588116 10191 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:07.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.592095 10191 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:07.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.592268 10191 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:07.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.592432 10191 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:07.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.592561 10191 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.733250 10191 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.130:34783
14:22:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.733353 10327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.130:34783 every 8 connection(s)
14:22:07.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.735715 10191 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/data/info.pb
14:22:07.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.739452  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10191
14:22:07.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.740070  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-1/wal/instance
14:22:07.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.755242  9758 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:07.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:07.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/logs
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data/info.pb
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:07.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.131:0
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.131
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.131
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:07.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.779673 10329 heartbeater.cc:344] Connected to a master server at 127.9.135.189:37257
14:22:07.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.780090 10329 heartbeater.cc:461] Registering TS with master...
14:22:07.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.781162 10329 heartbeater.cc:507] Master 127.9.135.189:37257 requested a full tablet report, sending...
14:22:07.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.783727  9878 ts_manager.cc:194] Registered new tserver with Master: b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130:34783)
14:22:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.788355 10330 heartbeater.cc:344] Connected to a master server at 127.9.135.190:41023
14:22:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.788668 10330 heartbeater.cc:461] Registering TS with master...
14:22:07.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.789402 10330 heartbeater.cc:507] Master 127.9.135.190:41023 requested a full tablet report, sending...
14:22:07.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.791158 10328 heartbeater.cc:344] Connected to a master server at 127.9.135.188:36123
14:22:07.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.791425 10328 heartbeater.cc:461] Registering TS with master...
14:22:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.791658  9803 ts_manager.cc:194] Registered new tserver with Master: b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130:34783)
14:22:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.792255 10328 heartbeater.cc:507] Master 127.9.135.188:36123 requested a full tablet report, sending...
14:22:07.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.795065  9958 ts_manager.cc:194] Registered new tserver with Master: b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130:34783)
14:22:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.796566  9958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.135.130:60653
14:22:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.075450 10338 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:08.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.075887 10338 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:08.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.076243 10338 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:08.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.108948 10338 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:08.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.109743 10338 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.135.131
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:08.143309 10338 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.135.148:38343
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.135.131:0
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data/info.pb
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.135.131
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.135.190:41023,127.9.135.189:37257,127.9.135.188:36123
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.135.131
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/logs
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:08.144364 10338 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:08.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:08.145751 10338 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:08.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.156487 10345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:08.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:08.803319 10328 heartbeater.cc:499] Master 127.9.135.188:36123 was elected leader, sending a full tablet report...
14:22:09.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:08.158671 10346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:09.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.316489 10348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.319057 10347 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1156 milliseconds
14:22:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.319218 10338 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:09.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.320369 10338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:09.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.322913 10338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:09.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.324319 10338 hybrid_clock.cc:648] HybridClock initialized: now 1779114129324273 us; error 45 us; skew 500 ppm
14:22:09.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.325207 10338 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.331486 10338 webserver.cc:533] Webserver started at http://127.9.135.131:39721/ using document root <none> and password file <none>
14:22:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.332245 10338 fs_manager.cc:362] Metadata directory not provided
14:22:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.332408 10338 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:09.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.332854 10338 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.336839 10338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data/instance:
14:22:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe7cc136039d4f84b96ca00654e80bad"
14:22:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-1n46"
14:22:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.337831 10338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal/instance:
14:22:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe7cc136039d4f84b96ca00654e80bad"
14:22:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-1n46"
14:22:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.344434 10338 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:22:09.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.350216 10355 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:09.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.351141 10338 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
14:22:09.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.351477 10338 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal
14:22:09.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe7cc136039d4f84b96ca00654e80bad"
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-1n46"
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.351830 10338 fs_report.cc:389] FS layout report
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data/data
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:09.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:09.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.422531 10338 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:09.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.424093 10338 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:09.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.424633 10338 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:09.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.427275 10338 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:09.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.431090 10338 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:09.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.431274 10338 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:09.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.431509 10338 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:09.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.431658 10338 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:09.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.570982 10338 rpc_server.cc:307] RPC server started. Bound to: 127.9.135.131:34859
14:22:09.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.571069 10467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.135.131:34859 every 8 connection(s)
14:22:09.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.573729 10338 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/data/info.pb
14:22:09.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.576647  9758 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10338
14:22:09.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.577037  9758 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15544968282880688904/ts-2/wal/instance
14:22:09.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.621591 10468 heartbeater.cc:344] Connected to a master server at 127.9.135.188:36123
14:22:09.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.622120 10468 heartbeater.cc:461] Registering TS with master...
14:22:09.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.623337 10468 heartbeater.cc:507] Master 127.9.135.188:36123 requested a full tablet report, sending...
14:22:09.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.625773  9958 ts_manager.cc:194] Registered new tserver with Master: fe7cc136039d4f84b96ca00654e80bad (127.9.135.131:34859)
14:22:09.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.627291  9958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.135.131:33347
14:22:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.646313 10469 heartbeater.cc:344] Connected to a master server at 127.9.135.189:37257
14:22:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.646616 10469 heartbeater.cc:461] Registering TS with master...
14:22:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.647255 10469 heartbeater.cc:507] Master 127.9.135.189:37257 requested a full tablet report, sending...
14:22:09.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.650732  9877 ts_manager.cc:194] Registered new tserver with Master: fe7cc136039d4f84b96ca00654e80bad (127.9.135.131:34859)
14:22:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.653347 10470 heartbeater.cc:344] Connected to a master server at 127.9.135.190:41023
14:22:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.653637 10470 heartbeater.cc:461] Registering TS with master...
14:22:09.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.654219 10470 heartbeater.cc:507] Master 127.9.135.190:41023 requested a full tablet report, sending...
14:22:09.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.656487  9803 ts_manager.cc:194] Registered new tserver with Master: fe7cc136039d4f84b96ca00654e80bad (127.9.135.131:34859)
14:22:09.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.669607  9758 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:22:09.682 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:09.683 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:22:09.692 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.135.190"
      port: 41023
    }
    bound_http_address {
      host: "127.9.135.190"
      port: 37189
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.135.189"
      port: 37257
    }
    bound_http_address {
      host: "127.9.135.189"
      port: 39237
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.135.188"
      port: 36123
    }
    bound_http_address {
      host: "127.9.135.188"
      port: 37075
    }
  }
}

14:22:09.695 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:22:09.697 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.135.129"
      port: 36655
    }
    bound_http_address {
      host: "127.9.135.129"
      port: 46475
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.135.130"
      port: 34783
    }
    bound_http_address {
      host: "127.9.135.130"
      port: 41487
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.135.131"
      port: 34859
    }
    bound_http_address {
      host: "127.9.135.131"
      port: 39721
    }
  }
}

14:22:09.697 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:22:09.709 [DEBUG - main] (InternalLoggerFactory.java:63) Using SLF4J as the default logging framework
14:22:09.712 [DEBUG - main] (ResourceLeakDetector.java:129) -Dorg.apache.kudu.shaded.io.netty.leakDetection.level: simple
14:22:09.712 [DEBUG - main] (ResourceLeakDetector.java:130) -Dorg.apache.kudu.shaded.io.netty.leakDetection.targetRecords: 4
14:22:09.716 [DEBUG - main] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@53de625d
14:22:09.739 [DEBUG - main] (PlatformDependent0.java:1138) Java version: 17
14:22:09.739 [DEBUG - main] (PlatformDependent0.java:616) -Dio.netty.noUnsafe: false
14:22:09.739 [DEBUG - main] (PlatformDependent0.java:559) Thread.isVirtual() is not available: 
14:22:09.740 [DEBUG - main] (PlatformDependent0.java:572) java.lang.BaseVirtualThread is not available: 
14:22:09.741 [DEBUG - main] (PlatformDependent0.java:145) sun.misc.Unsafe.theUnsafe: available
14:22:09.742 [DEBUG - main] (PlatformDependent0.java:208) sun.misc.Unsafe base methods: all available
14:22:09.742 [DEBUG - main] (PlatformDependent0.java:240) sun.misc.Unsafe.storeFence: available
14:22:09.743 [DEBUG - main] (PlatformDependent0.java:283) java.nio.Buffer.address: available
14:22:09.743 [DEBUG - main] (PlatformDependent0.java:369) direct buffer constructor: unavailable: Reflective setAccessible(true) disabled
14:22:09.744 [DEBUG - main] (PlatformDependent0.java:447) java.nio.Bits.unaligned: available, true
14:22:09.746 [DEBUG - main] (PlatformDependent0.java:515) jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable: class org.apache.kudu.shaded.io.netty.util.internal.PlatformDependent0$7 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @c540f5a
14:22:09.747 [DEBUG - main] (PlatformDependent0.java:545) java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable
14:22:09.747 [DEBUG - main] (PlatformDependent.java:1214) sun.misc.Unsafe: available
14:22:09.747 [DEBUG - main] (PlatformDependent.java:1360) -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
14:22:09.748 [DEBUG - main] (PlatformDependent.java:1439) -Dio.netty.bitMode: 64 (sun.arch.data.model)
14:22:09.749 [DEBUG - main] (PlatformDependent.java:181) -Dio.netty.maxDirectMemory: -1 bytes
14:22:09.749 [DEBUG - main] (PlatformDependent.java:188) -Dio.netty.uninitializedArrayAllocationThreshold: -1
14:22:09.750 [DEBUG - main] (CleanerJava9.java:71) java.nio.ByteBuffer.cleaner(): available
14:22:09.750 [DEBUG - main] (PlatformDependent.java:209) -Dio.netty.noPreferDirect: false
14:22:09.759 [DEBUG - main] (PlatformDependent.java:1048) org.jctools-core.MpscChunkedArrayQueue: available
14:22:09.798 [DEBUG - main] (MultithreadEventLoopGroup.java:44) -Dio.netty.eventLoopThreads: 8
14:22:09.813 [DEBUG - main] (GlobalEventExecutor.java:54) -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1
14:22:09.819 [DEBUG - main] (InternalThreadLocalMap.java:100) -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
14:22:09.819 [DEBUG - main] (InternalThreadLocalMap.java:101) -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
14:22:09.829 [DEBUG - main] (NioEventLoop.java:110) -Dio.netty.noKeySetOptimization: false
14:22:09.829 [DEBUG - main] (NioEventLoop.java:111) -Dio.netty.selectorAutoRebuildThreshold: 512
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:161) -Dio.netty.allocator.numHeapArenas: 8
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:162) -Dio.netty.allocator.numDirectArenas: 8
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:164) -Dio.netty.allocator.pageSize: 8192
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:169) -Dio.netty.allocator.maxOrder: 9
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:173) -Dio.netty.allocator.chunkSize: 4194304
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:174) -Dio.netty.allocator.smallCacheSize: 256
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:175) -Dio.netty.allocator.normalCacheSize: 64
14:22:09.884 [DEBUG - main] (PooledByteBufAllocator.java:176) -Dio.netty.allocator.maxCachedBufferCapacity: 32768
14:22:09.885 [DEBUG - main] (PooledByteBufAllocator.java:177) -Dio.netty.allocator.cacheTrimInterval: 8192
14:22:09.885 [DEBUG - main] (PooledByteBufAllocator.java:178) -Dio.netty.allocator.cacheTrimIntervalMillis: 0
14:22:09.885 [DEBUG - main] (PooledByteBufAllocator.java:179) -Dio.netty.allocator.useCacheForAllThreads: false
14:22:09.885 [DEBUG - main] (PooledByteBufAllocator.java:180) -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
14:22:09.885 [DEBUG - main] (PooledByteBufAllocator.java:182) -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false
14:22:09.904 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:22:09.965 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:10.048 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:22:10.049 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:22:10.049 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:22:10.049 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:22:10.053 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:22:10.370 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:10.371 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:22:10.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.374114 10480 mini_oidc.cc:150] Starting JWKS server
14:22:10.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.376868 10480 webserver.cc:533] Webserver started at http://127.0.0.1:36697/ using document root <none> and password file <none>
14:22:10.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.377190 10480 mini_oidc.cc:186] Starting OIDC Discovery server
14:22:10.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.379688 10480 webserver.cc:533] Webserver started at http://127.0.0.1:44963/ using document root <none> and password file <none>
14:22:10.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:22:10.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:10Z Disabled control of system clock
14:22:10.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.434460 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:10.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:10.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal
14:22:10.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/logs
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data/info.pb
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.62:34681
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.62
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json with env {}
14:22:10.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.631309 10468 heartbeater.cc:499] Master 127.9.135.188:36123 was elected leader, sending a full tablet report...
14:22:10.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.731328 10493 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:10.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.731920 10493 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:10.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.732446 10493 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:10.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.763159 10493 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:10.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.763486 10493 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:10.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.763845 10493 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:10.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.764148 10493 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:10.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.764478 10493 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:10.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.764719 10493 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36697/jwks.json
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.799592 10493 master_runner.cc:387] Master server non-default flags:
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.62:34681
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data/info.pb
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.62
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/logs
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:10.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.801175 10493 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:10.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.803540 10493 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:10.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.814000 10499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:12.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.817802 10500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.819929 10502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:12.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.051589 10501 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1236 milliseconds
14:22:12.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.051654 10493 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:12.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.056183 10493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:12.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.059240 10493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:12.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.060647 10493 hybrid_clock.cc:648] HybridClock initialized: now 1779114132060595 us; error 60 us; skew 500 ppm
14:22:12.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.061367 10493 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:12.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.067905 10493 webserver.cc:533] Webserver started at http://127.10.60.62:37577/ using document root <none> and password file <none>
14:22:12.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.068784 10493 fs_manager.cc:362] Metadata directory not provided
14:22:12.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.068959 10493 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:12.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.069331 10493 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.073572 10493 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data/instance:
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a4eb19dd5ae420390c5f926f3ff9280"
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:12 on dist-test-slave-1n46"
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.074613 10493 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal/instance:
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a4eb19dd5ae420390c5f926f3ff9280"
14:22:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:12 on dist-test-slave-1n46"
14:22:12.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.081341 10493 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
14:22:12.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.088052 10509 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:12.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.090354 10493 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.003s
14:22:12.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.091408 10493 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal
14:22:12.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a4eb19dd5ae420390c5f926f3ff9280"
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:12 on dist-test-slave-1n46"
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.091820 10493 fs_report.cc:389] FS layout report
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data/data
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:12.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:12.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:12.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:12.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:12.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.144366 10493 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.145756 10493 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.146221 10493 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:12.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.218415 10493 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.62:34681
14:22:12.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.218487 10560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.62:34681 every 8 connection(s)
14:22:12.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.220677 10493 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/data/info.pb
14:22:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.226768 10561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:12.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.228554 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10493
14:22:12.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.228977 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-0/wal/instance
14:22:12.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.232481 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:12.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:12.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal
14:22:12.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/logs
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data/info.pb
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.61:42317
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.61
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:12.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json with env {}
14:22:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.238607 10561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
14:22:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.265822 10561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } has no permanent_uuid. Determining permanent_uuid...
14:22:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.267932 10512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.271595 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.321007 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 1
14:22:12.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.325438 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.393795 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 2
14:22:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.397866 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.489320 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 3
14:22:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.494397 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.537138 10563 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:12.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.537616 10563 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:12.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.538097 10563 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:12.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.567672 10563 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:12.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.567922 10563 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:12.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.568111 10563 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:12.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.568312 10563 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:12.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.568616 10563 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:12.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.568861 10563 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36697/jwks.json
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.603709 10563 master_runner.cc:387] Master server non-default flags:
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.61:42317
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data/info.pb
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.61
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/logs
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.605260 10563 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.606894 10563 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:12.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.616919 10572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:12.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.637828 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 4
14:22:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.642978 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:12.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.942312 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 5
14:22:12.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.946435 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:13.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.493770 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 6
14:22:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.500413 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.61:42317: Network error: Client connection negotiation failed: client connection to 127.10.60.61:42317: connect: Connection refused (error 111)
14:22:13.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.618569 10573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:13.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:12.622140 10575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:13.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.770609 10574 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:22:13.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.771154 10563 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:13.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.775148 10563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:13.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.777541 10563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:13.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.778940 10563 hybrid_clock.cc:648] HybridClock initialized: now 1779114133778883 us; error 77 us; skew 500 ppm
14:22:13.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.779686 10563 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:13.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.785939 10563 webserver.cc:533] Webserver started at http://127.10.60.61:37225/ using document root <none> and password file <none>
14:22:13.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.787111 10563 fs_manager.cc:362] Metadata directory not provided
14:22:13.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.787307 10563 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:13.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.787797 10563 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:13.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.792255 10563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data/instance:
14:22:13.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25fd40ee8dfb4d2195bb93eb175d9770"
14:22:13.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:13 on dist-test-slave-1n46"
14:22:13.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.793212 10563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal/instance:
14:22:13.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25fd40ee8dfb4d2195bb93eb175d9770"
14:22:13.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:13 on dist-test-slave-1n46"
14:22:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.799855 10563 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.007s
14:22:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.804685 10585 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.805658 10563 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
14:22:13.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.806011 10563 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal
14:22:13.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25fd40ee8dfb4d2195bb93eb175d9770"
14:22:13.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:13 on dist-test-slave-1n46"
14:22:13.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.806380 10563 fs_report.cc:389] FS layout report
14:22:13.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data/data
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.855387 10563 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:13.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.856977 10563 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:13.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.857430 10563 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.932693 10563 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.61:42317
14:22:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.932757 10636 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.61:42317 every 8 connection(s)
14:22:13.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.935215 10563 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/data/info.pb
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.938211 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10563
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.938750 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-1/wal/instance
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.942207 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/logs
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data/info.pb
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.60:46387
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.60
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json with env {}
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.942834 10637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:13.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.956645 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
14:22:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.976804 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } has no permanent_uuid. Determining permanent_uuid...
14:22:13.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.990259 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } has no permanent_uuid. Determining permanent_uuid...
14:22:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.992478 10587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:13.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.996481 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.045905 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 1
14:22:14.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.051357 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.119742 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 2
14:22:14.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.123201 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.214537 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 3
14:22:14.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.219502 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.257616 10639 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:14.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.258189 10639 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:14.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.258627 10639 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.288815 10639 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.289065 10639 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.289248 10639 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.289433 10639 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.289695 10639 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:14.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.289916 10639 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36697/jwks.json
14:22:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.325520 10639 master_runner.cc:387] Master server non-default flags:
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.60:46387
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36697/jwks.json
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data/info.pb
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.60
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/logs
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.326941 10639 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:14.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.328547 10639 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.340008 10649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:14.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.362916 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 4
14:22:14.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.368898 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.560814 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } attempt: 7
14:22:14.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.604213 10561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } has no permanent_uuid. Determining permanent_uuid...
14:22:14.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.613708 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.668215 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 5
14:22:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.672739 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 1
14:22:14.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.677265 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.682126 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.763726 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 2
14:22:14.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.769338 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:14.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.854849 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 3
14:22:14.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.860423 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.000883 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 4
14:22:15.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:15.011365 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:15.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.224951 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 6
14:22:15.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:15.245849 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:15.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.294898 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 5
14:22:15.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:15.301185 10561 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.60.60:46387: Network error: Client connection negotiation failed: client connection to 127.10.60.60:46387: connect: Connection refused (error 111)
14:22:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.340845 10650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:15.632038 10652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:15.638480 10651 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1296 milliseconds
14:22:15.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.638656 10639 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.640154 10639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:15.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.643337 10639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:15.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.644793 10639 hybrid_clock.cc:648] HybridClock initialized: now 1779114135644743 us; error 33 us; skew 500 ppm
14:22:15.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.645879 10639 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:15.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.654639 10639 webserver.cc:533] Webserver started at http://127.10.60.60:41981/ using document root <none> and password file <none>
14:22:15.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.655823 10639 fs_manager.cc:362] Metadata directory not provided
14:22:15.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.656107 10639 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:15.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.656617 10639 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.663261 10639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data/instance:
14:22:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4e7dbdf5323d40e8bbef12992a8f95f5"
14:22:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:15 on dist-test-slave-1n46"
14:22:15.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.664988 10639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal/instance:
14:22:15.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4e7dbdf5323d40e8bbef12992a8f95f5"
14:22:15.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:15 on dist-test-slave-1n46"
14:22:15.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.675082 10639 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.000s
14:22:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.682212 10665 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:15.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.683346 10639 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
14:22:15.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.683663 10639 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4e7dbdf5323d40e8bbef12992a8f95f5"
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:15 on dist-test-slave-1n46"
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.683916 10639 fs_report.cc:389] FS layout report
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data/data
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:15.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:15.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:15.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:15.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:15.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.735180 10639 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:15.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.737048 10639 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:15.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.737521 10639 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:15.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.834947 10639 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.60:46387
14:22:15.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.834982 10717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.60:46387 every 8 connection(s)
14:22:15.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.837945 10639 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/data/info.pb
14:22:15.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.840721 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10639
14:22:15.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.841190 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/master-2/wal/instance
14:22:15.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.844486 10718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:15.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.853621 10561 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 6
14:22:15.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.866732 10718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
14:22:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.903282 10561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: Bootstrap starting.
14:22:15.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.905296 10718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } has no permanent_uuid. Determining permanent_uuid...
14:22:15.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.910342 10561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: Neither blocks nor log segments found. Creating new log.
14:22:15.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.912650 10561 log.cc:826] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: Log is configured to *not* fsync() on all Append() calls
14:22:15.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.915768 10718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } has no permanent_uuid. Determining permanent_uuid...
14:22:15.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.918283 10561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: No bootstrap required, opened a new log
14:22:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.946228 10718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: Bootstrap starting.
14:22:15.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.949240 10561 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:15.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.950457 10561 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:15.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.951047 10561 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a4eb19dd5ae420390c5f926f3ff9280, State: Initialized, Role: FOLLOWER
14:22:15.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.952553 10561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:15.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.958329 10718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: Neither blocks nor log segments found. Creating new log.
14:22:15.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.961266 10718 log.cc:826] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: Log is configured to *not* fsync() on all Append() calls
14:22:15.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.965601 10730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.967341 10561 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: configured and running, proceeding with master startup.
14:22:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.967619 10730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: This master's current role is: FOLLOWER
14:22:15.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.974514 10718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: No bootstrap required, opened a new log
14:22:15.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.977237 10730 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:15.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.978066 10730 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:15.983271 10730 leader_election.cc:290] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25fd40ee8dfb4d2195bb93eb175d9770 (127.10.60.61:42317), 4e7dbdf5323d40e8bbef12992a8f95f5 (127.10.60.60:46387)
14:22:16.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.001784 10718 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.002635 10718 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:16.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.002915 10718 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7dbdf5323d40e8bbef12992a8f95f5, State: Initialized, Role: FOLLOWER
14:22:16.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.003919 10718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.015386 10742 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.015707 10742 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.025219 10744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.026021 10744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.027051 10718 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: configured and running, proceeding with master startup.
14:22:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.027194 10693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" is_pre_election: true
14:22:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.028013 10693 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a4eb19dd5ae420390c5f926f3ff9280 in term 0.
14:22:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.029345 10511 leader_election.cc:304] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4eb19dd5ae420390c5f926f3ff9280, 4e7dbdf5323d40e8bbef12992a8f95f5; no voters: 
14:22:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.030565 10730 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:16.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.031205 10730 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:16.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.031939 10730 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 0 FOLLOWER]: Advancing to term 1
14:22:16.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.007965 10493 master_runner.cc:187] Error getting master registration for 127.10.60.61:42317: OK, instance_id { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" instance_seqno: 1779114133912418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:16.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.041087 10493 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:16.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.041277 10730 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.046396 10730 leader_election.cc:290] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [CANDIDATE]: Term 1 election: Requested vote from peers 25fd40ee8dfb4d2195bb93eb175d9770 (127.10.60.61:42317), 4e7dbdf5323d40e8bbef12992a8f95f5 (127.10.60.60:46387)
14:22:16.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.047660 10693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5"
14:22:16.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.048391 10693 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 0 FOLLOWER]: Advancing to term 1
14:22:16.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.057837 10693 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a4eb19dd5ae420390c5f926f3ff9280 in term 1.
14:22:16.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.059053 10511 leader_election.cc:304] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4eb19dd5ae420390c5f926f3ff9280, 4e7dbdf5323d40e8bbef12992a8f95f5; no voters: 
14:22:16.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.068746 10730 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 1 FOLLOWER]: Leader election won for term 1
14:22:16.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.073680 10730 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [term 1 LEADER]: Becoming Leader. State: Replica: 4a4eb19dd5ae420390c5f926f3ff9280, State: Running, Role: LEADER
14:22:16.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.074764 10730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.102613 10751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a4eb19dd5ae420390c5f926f3ff9280. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.104512 10751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: This master's current role is: LEADER
14:22:16.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.109787 10758 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:22:16.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.116595 10758 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:22:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.132045 10693 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [term 1 FOLLOWER]: Refusing update from remote peer 4a4eb19dd5ae420390c5f926f3ff9280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:16.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.137508 10751 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:16.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.149425 10757 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:16.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.149744 10757 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:16.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.155685 10515 tablet.cc:2404] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:16.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.122355 10639 master_runner.cc:187] Error getting master registration for 127.10.60.61:42317: OK, instance_id { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" instance_seqno: 1779114133912418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:16.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.165042 10639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:16.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.185091 10759 mvcc.cc:204] Tried to move back new op lower bound from 7287251501578158080 to 7287251501374189568. Current Snapshot: MvccSnapshot[applied={T|T < 7287251501578158080}]
14:22:16.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.187677 10744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a4eb19dd5ae420390c5f926f3ff9280. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.188501 10744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.199862 10744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.200452 10744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.208604 10730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.209287 10730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: This master's current role is: LEADER
14:22:16.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.212409 10758 catalog_manager.cc:1383] Generated new cluster ID: 21e3076385f34ca298289c17d62bd73b
14:22:16.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.222105 10758 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:22:16.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.266424 10758 catalog_manager.cc:1406] Generated new certificate authority record
14:22:16.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.272030 10758 catalog_manager.cc:1540] Loading token signing keys...
14:22:16.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.306573 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } attempt: 7
14:22:16.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.320540 10758 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: Generated new TSK 0
14:22:16.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.321552 10758 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:22:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.342938 10637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: Bootstrap starting.
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.351923 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/logs
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data/info.pb
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.1:0
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.1
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.1
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:16.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.354796 10637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: Neither blocks nor log segments found. Creating new log.
14:22:16.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.357208 10637 log.cc:826] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: Log is configured to *not* fsync() on all Append() calls
14:22:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.370280 10637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: No bootstrap required, opened a new log
14:22:16.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.425180 10637 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.426059 10637 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:16.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.426370 10637 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25fd40ee8dfb4d2195bb93eb175d9770, State: Initialized, Role: FOLLOWER
14:22:16.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.427222 10637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } }
14:22:16.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.443487 10637 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: configured and running, proceeding with master startup.
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.443627 10612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" is_pre_election: true
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.441453 10770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.444221 10770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.444356 10612 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a4eb19dd5ae420390c5f926f3ff9280 in term 0.
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.445689 10610 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 0 FOLLOWER]: Advancing to term 1
14:22:16.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.450224 10611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25fd40ee8dfb4d2195bb93eb175d9770"
14:22:16.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.453646 10610 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [term 1 FOLLOWER]: Refusing update from remote peer 4a4eb19dd5ae420390c5f926f3ff9280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:16.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.455367 10730 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:22:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.549271 10777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.549307 10770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a4eb19dd5ae420390c5f926f3ff9280. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.550473 10770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.550566 10777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770 [sys.catalog]: This master's current role is: FOLLOWER
14:22:16.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.633641 10786 catalog_manager.cc:1295] Loaded cluster ID: 21e3076385f34ca298289c17d62bd73b
14:22:16.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.633874 10786 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: loading cluster ID for follower catalog manager: success
14:22:16.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.657043 10786 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: acquiring CA information for follower catalog manager: success
14:22:16.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.661701 10786 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 25fd40ee8dfb4d2195bb93eb175d9770: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.956367 10730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a4eb19dd5ae420390c5f926f3ff9280" member_type: VOTER last_known_addr { host: "127.10.60.62" port: 34681 } } peers { permanent_uuid: "25fd40ee8dfb4d2195bb93eb175d9770" member_type: VOTER last_known_addr { host: "127.10.60.61" port: 42317 } } peers { permanent_uuid: "4e7dbdf5323d40e8bbef12992a8f95f5" member_type: VOTER last_known_addr { host: "127.10.60.60" port: 46387 } } }
14:22:16.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.957974 10730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280 [sys.catalog]: This master's current role is: LEADER
14:22:17.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.026117 10768 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:17.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.026747 10768 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:17.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.027446 10768 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:17.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.104378 10768 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:17.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.105522 10768 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.60.1
14:22:17.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.154635 10757 catalog_manager.cc:1295] Loaded cluster ID: 21e3076385f34ca298289c17d62bd73b
14:22:17.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.154888 10757 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: loading cluster ID for follower catalog manager: success
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.167632 10768 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.1:0
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data/info.pb
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.1
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.1
14:22:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/logs
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:17.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.169337 10768 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:17.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.171666 10768 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:17.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.161820 10757 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: acquiring CA information for follower catalog manager: success
14:22:17.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:17.179322 10757 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 4e7dbdf5323d40e8bbef12992a8f95f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:17.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.240904 10797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:18.609603 10795 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 10768
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.613911 10795 kernel_stack_watchdog.cc:198] Thread 10768 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 368ms:
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:19.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:19.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:17.242555 10796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:19.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.615715 10768 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.377s	user 0.611s	sys 1.063s
14:22:19.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.616132 10768 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.378s	user 0.611s	sys 1.064s
14:22:19.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.623805 10768 server_base.cc:1061] running on GCE node
14:22:19.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.624542 10805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:19.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.625730 10768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:19.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.628666 10768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:19.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.630064 10768 hybrid_clock.cc:648] HybridClock initialized: now 1779114139630022 us; error 41 us; skew 500 ppm
14:22:19.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.630999 10768 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:19.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.646270 10768 webserver.cc:533] Webserver started at http://127.10.60.1:42915/ using document root <none> and password file <none>
14:22:19.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.647293 10768 fs_manager.cc:362] Metadata directory not provided
14:22:19.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.647526 10768 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:19.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.648034 10768 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:19.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.656513 10768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data/instance:
14:22:19.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c08415addb64339a678077a5970c4e0"
14:22:19.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:19 on dist-test-slave-1n46"
14:22:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.658004 10768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal/instance:
14:22:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c08415addb64339a678077a5970c4e0"
14:22:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:19 on dist-test-slave-1n46"
14:22:19.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.678869 10768 fs_manager.cc:696] Time spent creating directory manager: real 0.020s	user 0.009s	sys 0.009s
14:22:19.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.692248 10810 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:19.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.693384 10768 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.005s	sys 0.004s
14:22:19.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.693719 10768 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal
14:22:19.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c08415addb64339a678077a5970c4e0"
14:22:19.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:19 on dist-test-slave-1n46"
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.694114 10768 fs_report.cc:389] FS layout report
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data/data
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:19.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.769028 10768 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:19.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.771385 10768 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:19.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.771966 10768 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.775543 10768 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:19.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.803244 10768 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:19.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.803508 10768 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.803789 10768 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.803983 10768 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:20.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.142119 10768 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.1:46175
14:22:20.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.142393 10923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.1:46175 every 8 connection(s)
14:22:20.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.144635 10768 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/data/info.pb
14:22:20.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.152814 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10768
14:22:20.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.153355 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-0/wal/instance
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.170696 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/logs
14:22:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data/info.pb
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.2:0
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.2
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.2
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:20.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.214872 10924 heartbeater.cc:344] Connected to a master server at 127.10.60.60:46387
14:22:20.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.215372 10924 heartbeater.cc:461] Registering TS with master...
14:22:20.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.216665 10924 heartbeater.cc:507] Master 127.10.60.60:46387 requested a full tablet report, sending...
14:22:20.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.227048 10682 ts_manager.cc:194] Registered new tserver with Master: 9c08415addb64339a678077a5970c4e0 (127.10.60.1:46175)
14:22:20.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.265216 10925 heartbeater.cc:344] Connected to a master server at 127.10.60.61:42317
14:22:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.265683 10925 heartbeater.cc:461] Registering TS with master...
14:22:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.266645 10925 heartbeater.cc:507] Master 127.10.60.61:42317 requested a full tablet report, sending...
14:22:20.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.270570 10602 ts_manager.cc:194] Registered new tserver with Master: 9c08415addb64339a678077a5970c4e0 (127.10.60.1:46175)
14:22:20.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.275261 10928 heartbeater.cc:344] Connected to a master server at 127.10.60.62:34681
14:22:20.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.275643 10928 heartbeater.cc:461] Registering TS with master...
14:22:20.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.276495 10928 heartbeater.cc:507] Master 127.10.60.62:34681 requested a full tablet report, sending...
14:22:20.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.278983 10525 ts_manager.cc:194] Registered new tserver with Master: 9c08415addb64339a678077a5970c4e0 (127.10.60.1:46175)
14:22:20.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.281402 10525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.60.1:48253
14:22:20.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.617633 10931 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:20.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.618381 10931 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:20.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.619415 10931 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:20.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.664193 10931 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:20.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.665261 10931 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.60.2
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.710407 10931 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.2:0
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data/info.pb
14:22:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.2
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.2
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/logs
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:20.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:20.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.712129 10931 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:20.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:20.714268 10931 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:20.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.746425 10941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:21.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:21.285006 10928 heartbeater.cc:499] Master 127.10.60.62:34681 was elected leader, sending a full tablet report...
14:22:22.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:20.762818 10942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.134088 10940 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 10931
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.239076 10940 kernel_stack_watchdog.cc:198] Thread 10931 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 368ms:
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.243968 10931 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.481s	user 0.460s	sys 0.910s
14:22:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.244308 10931 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.481s	user 0.460s	sys 0.910s
14:22:22.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.245913 10943 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1481 milliseconds
14:22:22.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.246026 10931 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:22.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.246114 10944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:22.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.247375 10931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.249732 10931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:22.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.251124 10931 hybrid_clock.cc:648] HybridClock initialized: now 1779114142251085 us; error 31 us; skew 500 ppm
14:22:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.252031 10931 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:22.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.259387 10931 webserver.cc:533] Webserver started at http://127.10.60.2:42633/ using document root <none> and password file <none>
14:22:22.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.260345 10931 fs_manager.cc:362] Metadata directory not provided
14:22:22.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.260521 10931 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:22.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.260861 10931 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.264658 10931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data/instance:
14:22:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21245d28728c4865a9eca7be205d1a16"
14:22:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:22 on dist-test-slave-1n46"
14:22:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.265679 10931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal/instance:
14:22:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21245d28728c4865a9eca7be205d1a16"
14:22:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:22 on dist-test-slave-1n46"
14:22:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.272889 10931 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
14:22:22.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.280139 10953 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.281150 10931 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
14:22:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.281427 10931 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal
14:22:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21245d28728c4865a9eca7be205d1a16"
14:22:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:22 on dist-test-slave-1n46"
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.281684 10931 fs_report.cc:389] FS layout report
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data/data
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.344549 10931 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.345856 10931 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.346254 10931 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:22.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.348981 10931 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:22.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.353011 10931 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:22.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.353175 10931 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:22.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.353351 10931 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:22.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.353468 10931 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:22.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.532318 11066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.2:33545 every 8 connection(s)
14:22:22.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.534906 10931 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.2:33545
14:22:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.538352 10931 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/data/info.pb
14:22:22.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.540014 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 10931
14:22:22.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.540720 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-1/wal/instance
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.554936 10480 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/logs
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data/info.pb
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.3:0
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.3
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.3
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:22.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.620141 11067 heartbeater.cc:344] Connected to a master server at 127.10.60.60:46387
14:22:22.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.620600 11067 heartbeater.cc:461] Registering TS with master...
14:22:22.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.621645 11070 heartbeater.cc:344] Connected to a master server at 127.10.60.61:42317
14:22:22.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.621730 11067 heartbeater.cc:507] Master 127.10.60.60:46387 requested a full tablet report, sending...
14:22:22.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.622211 11070 heartbeater.cc:461] Registering TS with master...
14:22:22.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.623149 11070 heartbeater.cc:507] Master 127.10.60.61:42317 requested a full tablet report, sending...
14:22:22.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.624527 10682 ts_manager.cc:194] Registered new tserver with Master: 21245d28728c4865a9eca7be205d1a16 (127.10.60.2:33545)
14:22:22.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.626391 10602 ts_manager.cc:194] Registered new tserver with Master: 21245d28728c4865a9eca7be205d1a16 (127.10.60.2:33545)
14:22:22.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.632256 11072 heartbeater.cc:344] Connected to a master server at 127.10.60.62:34681
14:22:22.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.632545 11072 heartbeater.cc:461] Registering TS with master...
14:22:22.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.633221 11072 heartbeater.cc:507] Master 127.10.60.62:34681 requested a full tablet report, sending...
14:22:22.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.634940 10525 ts_manager.cc:194] Registered new tserver with Master: 21245d28728c4865a9eca7be205d1a16 (127.10.60.2:33545)
14:22:22.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.636543 10525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.60.2:39099
14:22:22.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.919914 11071 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:22.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.920305 11071 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:22.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.920671 11071 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.951972 11071 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:22.952621 11071 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.60.3
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.985308 11071 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.60.20:43797
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal
14:22:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.60.3:0
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data/info.pb
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.60.3
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.60.3
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/logs
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:22.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.986577 11071 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:22.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:22.988451 11071 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:23.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:23.000242 11083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:23.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:23.639745 11072 heartbeater.cc:499] Master 127.10.60.62:34681 was elected leader, sending a full tablet report...
14:22:24.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:23.002707 11084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:24.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:23.005861 11086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:24.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:24.152750 11085 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:22:24.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.152792 11071 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:24.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.156236 11071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:24.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.158268 11071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:24.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.159613 11071 hybrid_clock.cc:648] HybridClock initialized: now 1779114144159579 us; error 31 us; skew 500 ppm
14:22:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.160401 11071 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:24.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.166810 11071 webserver.cc:533] Webserver started at http://127.10.60.3:41705/ using document root <none> and password file <none>
14:22:24.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.167641 11071 fs_manager.cc:362] Metadata directory not provided
14:22:24.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.167878 11071 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:24.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.168430 11071 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:24.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.172605 11071 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data/instance:
14:22:24.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21f3d90837b8457aaa49a7f96bd7c22a"
14:22:24.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:24 on dist-test-slave-1n46"
14:22:24.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.173727 11071 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal/instance:
14:22:24.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21f3d90837b8457aaa49a7f96bd7c22a"
14:22:24.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:24 on dist-test-slave-1n46"
14:22:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.180451 11071 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:22:24.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.186228 11094 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:24.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.187472 11071 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
14:22:24.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.187842 11071 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal
14:22:24.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21f3d90837b8457aaa49a7f96bd7c22a"
14:22:24.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:24 on dist-test-slave-1n46"
14:22:24.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.188191 11071 fs_report.cc:389] FS layout report
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data/data
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.247018 11071 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.248737 11071 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.249130 11071 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:24.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.251616 11071 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:24.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.255558 11071 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:24.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.255782 11071 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:24.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.256064 11071 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:24.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.256235 11071 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:24.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.395848 11071 rpc_server.cc:307] RPC server started. Bound to: 127.10.60.3:34579
14:22:24.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.395947 11207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.60.3:34579 every 8 connection(s)
14:22:24.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.398427 11071 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/data/info.pb
14:22:24.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.401050 10480 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 11071
14:22:24.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.401453 10480 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster17307928251842256938/ts-2/wal/instance
14:22:24.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.463487 11209 heartbeater.cc:344] Connected to a master server at 127.10.60.61:42317
14:22:24.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.463971 11209 heartbeater.cc:461] Registering TS with master...
14:22:24.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.465256 11209 heartbeater.cc:507] Master 127.10.60.61:42317 requested a full tablet report, sending...
14:22:24.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.466027 11208 heartbeater.cc:344] Connected to a master server at 127.10.60.60:46387
14:22:24.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.466388 11208 heartbeater.cc:461] Registering TS with master...
14:22:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.467458 11208 heartbeater.cc:507] Master 127.10.60.60:46387 requested a full tablet report, sending...
14:22:24.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.469064 10602 ts_manager.cc:194] Registered new tserver with Master: 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:24.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.469126 11210 heartbeater.cc:344] Connected to a master server at 127.10.60.62:34681
14:22:24.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.469466 11210 heartbeater.cc:461] Registering TS with master...
14:22:24.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.470381 11210 heartbeater.cc:507] Master 127.10.60.62:34681 requested a full tablet report, sending...
14:22:24.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.470263 10682 ts_manager.cc:194] Registered new tserver with Master: 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:24.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.472656 10525 ts_manager.cc:194] Registered new tserver with Master: 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:24.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.474191 10525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.60.3:37165
14:22:24.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:24.480816 10480 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:22:24.493 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:24.493 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:22:24.497 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.60.62"
      port: 34681
    }
    bound_http_address {
      host: "127.10.60.62"
      port: 37577
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.60.61"
      port: 42317
    }
    bound_http_address {
      host: "127.10.60.61"
      port: 37225
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.60.60"
      port: 46387
    }
    bound_http_address {
      host: "127.10.60.60"
      port: 41981
    }
  }
}

14:22:24.498 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:22:24.499 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.60.1"
      port: 46175
    }
    bound_http_address {
      host: "127.10.60.1"
      port: 42915
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.60.2"
      port: 33545
    }
    bound_http_address {
      host: "127.10.60.2"
      port: 42633
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.60.3"
      port: 34579
    }
    bound_http_address {
      host: "127.10.60.3"
      port: 41705
    }
  }
}

14:22:24.500 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:22:24.502 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:24.577 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:24.588 [DEBUG - main] (DefaultChannelId.java:84) -Dio.netty.processId: 9732 (auto-detected)
14:22:24.590 [DEBUG - main] (NetUtil.java:149) -Djava.net.preferIPv4Stack: true
14:22:24.590 [DEBUG - main] (NetUtil.java:150) -Djava.net.preferIPv6Addresses: false
14:22:24.592 [DEBUG - main] (NetUtilInitializations.java:145) Loopback interface: lo (lo, 127.0.0.1)
14:22:24.593 [DEBUG - main] (NetUtil.java:198) /proc/sys/net/core/somaxconn: 4096
14:22:24.594 [DEBUG - main] (DefaultChannelId.java:106) -Dio.netty.machineId: 02:42:75:ff:fe:dc:34:22 (auto-detected)
14:22:24.618 [DEBUG - main] (ByteBufUtil.java:89) -Dio.netty.allocator.type: pooled
14:22:24.618 [DEBUG - main] (ByteBufUtil.java:101) -Dio.netty.threadLocalDirectBufferSize: 0
14:22:24.619 [DEBUG - main] (ByteBufUtil.java:104) -Dio.netty.maxThreadLocalCharBufferSize: 16384
14:22:24.625 [DEBUG - main] (ChannelInitializerExtensions.java:54) -Dio.netty.bootstrap.extensions: null
14:22:24.630 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:24.632 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:24.657 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.135.189:37257(127.9.135.189:37257)] Successfully connected to peer
14:22:24.657 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.135.190:41023(127.9.135.190:41023)] Successfully connected to peer
14:22:24.657 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.135.188:36123(127.9.135.188:36123)] Successfully connected to peer
14:22:24.690 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:63) -Dorg.apache.kudu.shaded.io.netty.buffer.checkAccessible: true
14:22:24.691 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:64) -Dorg.apache.kudu.shaded.io.netty.buffer.checkBounds: true
14:22:24.691 [DEBUG - kudu-nio-1] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@79ed2d7f
14:22:24.695 [DEBUG - kudu-nio-1] (Recycler.java:96) -Dio.netty.recycler.maxCapacityPerThread: 4096
14:22:24.695 [DEBUG - kudu-nio-1] (Recycler.java:97) -Dio.netty.recycler.ratio: 8
14:22:24.695 [DEBUG - kudu-nio-1] (Recycler.java:98) -Dio.netty.recycler.chunkSize: 32
14:22:24.696 [DEBUG - kudu-nio-1] (Recycler.java:99) -Dio.netty.recycler.blocking: false
14:22:24.696 [DEBUG - kudu-nio-1] (Recycler.java:100) -Dio.netty.recycler.batchFastThreadLocalOnly: true
14:22:24.766 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.190
14:22:24.766 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.188
14:22:24.766 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.189
14:22:24.940 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:24.940 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:24.950 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:24.973 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfabd8f23, L:/127.0.0.1:35932 - R:/127.9.135.190:41023] using SASL/PLAIN
14:22:24.973 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8387b2ea, L:/127.0.0.1:34694 - R:/127.9.135.188:36123] using SASL/PLAIN
14:22:24.973 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x62495619, L:/127.0.0.1:55104 - R:/127.9.135.189:37257] using SASL/PLAIN
14:22:25.010 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:25.011 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=475), Traces: [0ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [445ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: OK, [446ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: OK, [448ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: OK, deferred=null) after lookup
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.054869  9957 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34694:
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:25.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000\006\001d\000\000\000\007\001\310\000\000\000"
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:22:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:22:25.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:22:25.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:22:25.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:25.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:25.059094  9957 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:22:25.122 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:25.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.158936 10403 tablet_service.cc:1511] Processing CreateTablet for tablet 51b44ae8905d442d8b20115e40f20fed (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:25.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.162832 10403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b44ae8905d442d8b20115e40f20fed. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.170804 10402 tablet_service.cc:1511] Processing CreateTablet for tablet 50cb35d3b02948878cf1ff38928ff1f1 (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:25.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.172344 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50cb35d3b02948878cf1ff38928ff1f1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.204741 11241 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Bootstrap starting.
14:22:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.208599 10263 tablet_service.cc:1511] Processing CreateTablet for tablet 51b44ae8905d442d8b20115e40f20fed (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:25.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.212018 10121 tablet_service.cc:1511] Processing CreateTablet for tablet 50cb35d3b02948878cf1ff38928ff1f1 (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.213605 11241 tablet_bootstrap.cc:654] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Neither blocks nor log segments found. Creating new log.
14:22:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.213364 10262 tablet_service.cc:1511] Processing CreateTablet for tablet 50cb35d3b02948878cf1ff38928ff1f1 (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.213924 10263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b44ae8905d442d8b20115e40f20fed. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.214920 10262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50cb35d3b02948878cf1ff38928ff1f1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.215505 10121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50cb35d3b02948878cf1ff38928ff1f1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.216602 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 51b44ae8905d442d8b20115e40f20fed (DEFAULT_TABLE table=replication_test_table [id=e19ca4dde081409b893f0b30503e7625]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:25.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.218971 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b44ae8905d442d8b20115e40f20fed. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:25.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.239547 11241 log.cc:826] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Log is configured to *not* fsync() on all Append() calls
14:22:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.264683 11241 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: No bootstrap required, opened a new log
14:22:25.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.265672 11241 ts_tablet_manager.cc:1403] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.005s
14:22:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.267413 11242 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: Bootstrap starting.
14:22:25.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.269191 11244 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Bootstrap starting.
14:22:25.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.280596 11242 tablet_bootstrap.cc:654] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: Neither blocks nor log segments found. Creating new log.
14:22:25.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.280997 11244 tablet_bootstrap.cc:654] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Neither blocks nor log segments found. Creating new log.
14:22:25.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.284134 11242 log.cc:826] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: Log is configured to *not* fsync() on all Append() calls
14:22:25.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.284134 11244 log.cc:826] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Log is configured to *not* fsync() on all Append() calls
14:22:25.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.295415 11241 raft_consensus.cc:359] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.297197 11241 raft_consensus.cc:385] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.297533 11241 raft_consensus.cc:740] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe7cc136039d4f84b96ca00654e80bad, State: Initialized, Role: FOLLOWER
14:22:25.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.298540 11241 consensus_queue.cc:260] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.299202 11244 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: No bootstrap required, opened a new log
14:22:25.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.299716 11244 ts_tablet_manager.cc:1403] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.003s
14:22:25.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.300705 11242 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: No bootstrap required, opened a new log
14:22:25.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.301187 11242 ts_tablet_manager.cc:1403] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.017s
14:22:25.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.304453 11241 ts_tablet_manager.cc:1434] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Time spent starting tablet: real 0.038s	user 0.030s	sys 0.004s
14:22:25.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.306627 11241 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad: Bootstrap starting.
14:22:25.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.313014 11241 tablet_bootstrap.cc:654] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad: Neither blocks nor log segments found. Creating new log.
14:22:25.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.324661 11241 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad: No bootstrap required, opened a new log
14:22:25.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.325151 11241 ts_tablet_manager.cc:1403] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
14:22:25.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.327443 11241 raft_consensus.cc:359] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.327890 11241 raft_consensus.cc:385] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.328161 11241 raft_consensus.cc:740] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe7cc136039d4f84b96ca00654e80bad, State: Initialized, Role: FOLLOWER
14:22:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.328714 11241 consensus_queue.cc:260] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.330730 11241 ts_tablet_manager.cc:1434] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
14:22:25.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.331748 11244 raft_consensus.cc:359] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.332937 11244 raft_consensus.cc:385] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.333451 11244 raft_consensus.cc:740] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87306fca0b04ad6ba2642cf571feb46, State: Initialized, Role: FOLLOWER
14:22:25.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.334568 11244 consensus_queue.cc:260] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.352746 11244 ts_tablet_manager.cc:1434] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Time spent starting tablet: real 0.053s	user 0.017s	sys 0.022s
14:22:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.354022 11244 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46: Bootstrap starting.
14:22:25.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.355587 11242 raft_consensus.cc:359] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.356667 11242 raft_consensus.cc:385] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.357084 11242 raft_consensus.cc:740] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c968dd33116421ebd3ac5c09bb77731, State: Initialized, Role: FOLLOWER
14:22:25.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.358119 11242 consensus_queue.cc:260] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.361649 11244 tablet_bootstrap.cc:654] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46: Neither blocks nor log segments found. Creating new log.
14:22:25.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.366858 11242 ts_tablet_manager.cc:1434] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731: Time spent starting tablet: real 0.062s	user 0.032s	sys 0.004s
14:22:25.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:25.369649 10475 tablet.cc:2404] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:25.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.371176 11242 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: Bootstrap starting.
14:22:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.377678 11242 tablet_bootstrap.cc:654] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: Neither blocks nor log segments found. Creating new log.
14:22:25.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.380368 11244 tablet_bootstrap.cc:492] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46: No bootstrap required, opened a new log
14:22:25.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.380697 11244 ts_tablet_manager.cc:1403] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.012s
14:22:25.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.383380 11244 raft_consensus.cc:359] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.384683 11244 raft_consensus.cc:385] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.385183 11244 raft_consensus.cc:740] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87306fca0b04ad6ba2642cf571feb46, State: Initialized, Role: FOLLOWER
14:22:25.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.388271 11244 consensus_queue.cc:260] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.391202 11244 ts_tablet_manager.cc:1434] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
14:22:25.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.393147 11242 tablet_bootstrap.cc:492] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: No bootstrap required, opened a new log
14:22:25.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.394371 11242 ts_tablet_manager.cc:1403] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
14:22:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.397521 11242 raft_consensus.cc:359] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.398398 11242 raft_consensus.cc:385] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:25.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.398831 11242 raft_consensus.cc:740] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c968dd33116421ebd3ac5c09bb77731, State: Initialized, Role: FOLLOWER
14:22:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.399674 11242 consensus_queue.cc:260] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.401880 11242 ts_tablet_manager.cc:1434] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
14:22:25.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.477337 11210 heartbeater.cc:499] Master 127.10.60.62:34681 was elected leader, sending a full tablet report...
14:22:25.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.528475 11247 raft_consensus.cc:493] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:25.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.529083 11247 raft_consensus.cc:515] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.535542 11247 leader_election.cc:290] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655), b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130:34783)
14:22:25.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:25.551654 10335 tablet.cc:2404] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.555979 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b44ae8905d442d8b20115e40f20fed" candidate_uuid: "fe7cc136039d4f84b96ca00654e80bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87306fca0b04ad6ba2642cf571feb46" is_pre_election: true
14:22:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.556362 10142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b44ae8905d442d8b20115e40f20fed" candidate_uuid: "fe7cc136039d4f84b96ca00654e80bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c968dd33116421ebd3ac5c09bb77731" is_pre_election: true
14:22:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.556782 10283 raft_consensus.cc:2468] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe7cc136039d4f84b96ca00654e80bad in term 0.
14:22:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.557178 10142 raft_consensus.cc:2468] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe7cc136039d4f84b96ca00654e80bad in term 0.
14:22:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.558260 10359 leader_election.cc:304] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87306fca0b04ad6ba2642cf571feb46, fe7cc136039d4f84b96ca00654e80bad; no voters: 
14:22:25.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.559122 11247 raft_consensus.cc:2804] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:25.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.559409 11247 raft_consensus.cc:493] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.559731 11247 raft_consensus.cc:3060] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Advancing to term 1
14:22:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.564682 11247 raft_consensus.cc:515] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.566257 11247 leader_election.cc:290] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [CANDIDATE]: Term 1 election: Requested vote from peers 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655), b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130:34783)
14:22:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.566829 10142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b44ae8905d442d8b20115e40f20fed" candidate_uuid: "fe7cc136039d4f84b96ca00654e80bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c968dd33116421ebd3ac5c09bb77731"
14:22:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.567313 10142 raft_consensus.cc:3060] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Advancing to term 1
14:22:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.567622 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b44ae8905d442d8b20115e40f20fed" candidate_uuid: "fe7cc136039d4f84b96ca00654e80bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87306fca0b04ad6ba2642cf571feb46"
14:22:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.568017 10283 raft_consensus.cc:3060] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Advancing to term 1
14:22:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.572839 10142 raft_consensus.cc:2468] T 51b44ae8905d442d8b20115e40f20fed P 3c968dd33116421ebd3ac5c09bb77731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe7cc136039d4f84b96ca00654e80bad in term 1.
14:22:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.573802 10358 leader_election.cc:304] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c968dd33116421ebd3ac5c09bb77731, fe7cc136039d4f84b96ca00654e80bad; no voters: 
14:22:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.574563 11247 raft_consensus.cc:2804] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 1 FOLLOWER]: Leader election won for term 1
14:22:25.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.574612 10283 raft_consensus.cc:2468] T 51b44ae8905d442d8b20115e40f20fed P b87306fca0b04ad6ba2642cf571feb46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe7cc136039d4f84b96ca00654e80bad in term 1.
14:22:25.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.576366 11247 raft_consensus.cc:697] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [term 1 LEADER]: Becoming Leader. State: Replica: fe7cc136039d4f84b96ca00654e80bad, State: Running, Role: LEADER
14:22:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.577409 11247 consensus_queue.cc:237] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } }
14:22:25.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.586831  9957 catalog_manager.cc:5697] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad reported cstate change: term changed from 0 to 1, leader changed from <none> to fe7cc136039d4f84b96ca00654e80bad (127.9.135.131). New cstate: current_term: 1 leader_uuid: "fe7cc136039d4f84b96ca00654e80bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } health_report { overall_health: UNKNOWN } } }
14:22:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:25.592046 10195 tablet.cc:2404] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:25.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.599823 11249 raft_consensus.cc:493] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:25.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.600315 11249 raft_consensus.cc:515] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.607205 11249 leader_election.cc:290] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655), fe7cc136039d4f84b96ca00654e80bad (127.9.135.131:34859)
14:22:25.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.626380 10142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50cb35d3b02948878cf1ff38928ff1f1" candidate_uuid: "b87306fca0b04ad6ba2642cf571feb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c968dd33116421ebd3ac5c09bb77731" is_pre_election: true
14:22:25.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.626984 10142 raft_consensus.cc:2468] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87306fca0b04ad6ba2642cf571feb46 in term 0.
14:22:25.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.628571 10218 leader_election.cc:304] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c968dd33116421ebd3ac5c09bb77731, b87306fca0b04ad6ba2642cf571feb46; no voters: 
14:22:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.629412 11249 raft_consensus.cc:2804] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.629784 11249 raft_consensus.cc:493] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.630113 11249 raft_consensus.cc:3060] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 0 FOLLOWER]: Advancing to term 1
14:22:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.631567 10423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50cb35d3b02948878cf1ff38928ff1f1" candidate_uuid: "b87306fca0b04ad6ba2642cf571feb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe7cc136039d4f84b96ca00654e80bad" is_pre_election: true
14:22:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.632268 10423 raft_consensus.cc:2468] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87306fca0b04ad6ba2642cf571feb46 in term 0.
14:22:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.636904 11249 raft_consensus.cc:515] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.638953 11249 leader_election.cc:290] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [CANDIDATE]: Term 1 election: Requested vote from peers 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655), fe7cc136039d4f84b96ca00654e80bad (127.9.135.131:34859)
14:22:25.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.639055 10142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50cb35d3b02948878cf1ff38928ff1f1" candidate_uuid: "b87306fca0b04ad6ba2642cf571feb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c968dd33116421ebd3ac5c09bb77731"
14:22:25.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.639560 10142 raft_consensus.cc:3060] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 0 FOLLOWER]: Advancing to term 1
14:22:25.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.639807 10423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50cb35d3b02948878cf1ff38928ff1f1" candidate_uuid: "b87306fca0b04ad6ba2642cf571feb46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe7cc136039d4f84b96ca00654e80bad"
14:22:25.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.640202 10423 raft_consensus.cc:3060] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 0 FOLLOWER]: Advancing to term 1
14:22:25.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.643927 10142 raft_consensus.cc:2468] T 50cb35d3b02948878cf1ff38928ff1f1 P 3c968dd33116421ebd3ac5c09bb77731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87306fca0b04ad6ba2642cf571feb46 in term 1.
14:22:25.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.644846 10218 leader_election.cc:304] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c968dd33116421ebd3ac5c09bb77731, b87306fca0b04ad6ba2642cf571feb46; no voters: 
14:22:25.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.646111 11249 raft_consensus.cc:2804] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 1 FOLLOWER]: Leader election won for term 1
14:22:25.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.647091 10423 raft_consensus.cc:2468] T 50cb35d3b02948878cf1ff38928ff1f1 P fe7cc136039d4f84b96ca00654e80bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87306fca0b04ad6ba2642cf571feb46 in term 1.
14:22:25.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.650628 11249 raft_consensus.cc:697] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [term 1 LEADER]: Becoming Leader. State: Replica: b87306fca0b04ad6ba2642cf571feb46, State: Running, Role: LEADER
14:22:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.651859 11249 consensus_queue.cc:237] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } }
14:22:25.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:25.668807  9957 catalog_manager.cc:5697] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87306fca0b04ad6ba2642cf571feb46 (127.9.135.130). New cstate: current_term: 1 leader_uuid: "b87306fca0b04ad6ba2642cf571feb46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
14:22:26.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:26.094545 11249 consensus_queue.cc:1048] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:22:26.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:26.132609 11249 consensus_queue.cc:1048] T 50cb35d3b02948878cf1ff38928ff1f1 P b87306fca0b04ad6ba2642cf571feb46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe7cc136039d4f84b96ca00654e80bad" member_type: VOTER last_known_addr { host: "127.9.135.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:26.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:26.133610 11269 consensus_queue.cc:1048] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c968dd33116421ebd3ac5c09bb77731" member_type: VOTER last_known_addr { host: "127.9.135.129" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:22:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:26.168634 11269 consensus_queue.cc:1048] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87306fca0b04ad6ba2642cf571feb46" member_type: VOTER last_known_addr { host: "127.9.135.130" port: 34783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:26.383 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:26.406 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:26.406 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:26.408 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998}]
14:22:26.409 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=18), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC GetTableLocations: received response from server master-127.9.135.188:36123: OK, deferred=null) after lookup
14:22:26.417 [DEBUG - kudu-nio-0] (Connection.java:748) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] connecting to peer
14:22:26.419 [DEBUG - kudu-nio-3] (Connection.java:757) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] Successfully connected to peer
14:22:26.477 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:26.487 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8f03b586, L:/127.0.0.1:44414 - R:/127.9.135.131:34859] using TOKEN/null
14:22:26.668 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:26.670 [DEBUG - main] (Connection.java:748) [peer b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)] connecting to peer
14:22:26.679 [DEBUG - kudu-nio-4] (Connection.java:757) [peer b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)] Successfully connected to peer
14:22:26.716 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:26.721 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x0e630d5b, L:/127.0.0.1:43088 - R:/127.9.135.130:34783] using TOKEN/null
14:22:26.873 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:26.886 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:26.888 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:26.889 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:26.891 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:26.891 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:26.898 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:26.914 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:26.918 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:26.922 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:26.955 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.60
14:22:26.969 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:26.975 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:26.976 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3dc88409, L:/127.0.0.1:37324 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:26.981 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x80ef6c7e, L:/127.0.0.1:50912 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:26.981 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:26.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:26.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=99), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [93ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: OK, [98ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, deferred=null) after lookup
14:22:26.988 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4729eeb0, L:/127.0.0.1:42460 - R:/127.10.60.60:46387] using SASL/PLAIN
14:22:27.000 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:27.001 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:27.002 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.135.188:36123(127.9.135.188:36123)] Successfully connected to peer
14:22:27.006 [DEBUG - main] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:27.007 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.135.189:37257(127.9.135.189:37257)] Successfully connected to peer
14:22:27.009 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.135.190:41023(127.9.135.190:41023)] Successfully connected to peer
14:22:27.018 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.189
14:22:27.020 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.188
14:22:27.027 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.190
14:22:27.045 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:27.046 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:27.051 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x754b18b3, L:/127.0.0.1:55108 - R:/127.9.135.189:37257] using SASL/PLAIN
14:22:27.052 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2f96f01a, L:/127.0.0.1:34704 - R:/127.9.135.188:36123] using SASL/PLAIN
14:22:27.056 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:27.056 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=56), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [55ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: OK, deferred=null) after lookup
14:22:27.061 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:27.066 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:27.070 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x22015561, L:/127.0.0.1:35936 - R:/127.9.135.190:41023] using SASL/PLAIN
14:22:27.091 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:27.092 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:27.092 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.116204 10525 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50912:
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:22:27.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:22:27.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000"
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:27.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:22:27.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:27.120504 10525 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:22:27.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:27.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.205727 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 698e76971cae438590bc0895c41f9266 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:27.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.208042 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698e76971cae438590bc0895c41f9266. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:27.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.237037 11143 tablet_service.cc:1511] Processing CreateTablet for tablet 698e76971cae438590bc0895c41f9266 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.239943 11143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698e76971cae438590bc0895c41f9266. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:27.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.258497 11316 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Bootstrap starting.
14:22:27.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.268325 11316 tablet_bootstrap.cc:654] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Neither blocks nor log segments found. Creating new log.
14:22:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.270759 11316 log.cc:826] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Log is configured to *not* fsync() on all Append() calls
14:22:27.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.273371 10859 tablet_service.cc:1511] Processing CreateTablet for tablet 698e76971cae438590bc0895c41f9266 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
14:22:27.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.277935 10859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698e76971cae438590bc0895c41f9266. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:27.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.282219 11316 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: No bootstrap required, opened a new log
14:22:27.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.282850 11316 ts_tablet_manager.cc:1403] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
14:22:27.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.294207 11318 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Bootstrap starting.
14:22:27.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.304430 11318 tablet_bootstrap.cc:654] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Neither blocks nor log segments found. Creating new log.
14:22:27.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.306484 11318 log.cc:826] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Log is configured to *not* fsync() on all Append() calls
14:22:27.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.312804 11319 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Bootstrap starting.
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.322708 11319 tablet_bootstrap.cc:654] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Neither blocks nor log segments found. Creating new log.
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.322883 11316 raft_consensus.cc:359] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.323864 11316 raft_consensus.cc:385] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.324384 11316 raft_consensus.cc:740] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21245d28728c4865a9eca7be205d1a16, State: Initialized, Role: FOLLOWER
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.325629 11319 log.cc:826] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Log is configured to *not* fsync() on all Append() calls
14:22:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.325546 11316 consensus_queue.cc:260] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.329648 11318 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: No bootstrap required, opened a new log
14:22:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.330555 11318 ts_tablet_manager.cc:1403] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.016s
14:22:27.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.339175 11319 tablet_bootstrap.cc:492] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: No bootstrap required, opened a new log
14:22:27.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.339834 11316 ts_tablet_manager.cc:1434] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Time spent starting tablet: real 0.057s	user 0.040s	sys 0.007s
14:22:27.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.340401 11319 ts_tablet_manager.cc:1403] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
14:22:27.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:27.365805 11075 tablet.cc:2404] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:27.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.367676 11318 raft_consensus.cc:359] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.368748 11318 raft_consensus.cc:385] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:27.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.369061 11318 raft_consensus.cc:740] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f3d90837b8457aaa49a7f96bd7c22a, State: Initialized, Role: FOLLOWER
14:22:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.369939 11318 consensus_queue.cc:260] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.370405 11319 raft_consensus.cc:359] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.371016 11319 raft_consensus.cc:385] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.371340 11319 raft_consensus.cc:740] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c08415addb64339a678077a5970c4e0, State: Initialized, Role: FOLLOWER
14:22:27.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.372449 11319 consensus_queue.cc:260] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.373875 11318 ts_tablet_manager.cc:1434] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Time spent starting tablet: real 0.043s	user 0.031s	sys 0.005s
14:22:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.382557 11319 ts_tablet_manager.cc:1434] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Time spent starting tablet: real 0.042s	user 0.025s	sys 0.016s
14:22:27.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:27.449820 11215 tablet.cc:2404] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:27.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:27.522156 10932 tablet.cc:2404] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:27.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.614955 11324 raft_consensus.cc:493] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:27.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.615464 11324 raft_consensus.cc:515] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.618135 11324 leader_election.cc:290] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21245d28728c4865a9eca7be205d1a16 (127.10.60.2:33545), 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:27.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.633381 11021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698e76971cae438590bc0895c41f9266" candidate_uuid: "9c08415addb64339a678077a5970c4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21245d28728c4865a9eca7be205d1a16" is_pre_election: true
14:22:27.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.634099 11021 raft_consensus.cc:2468] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c08415addb64339a678077a5970c4e0 in term 0.
14:22:27.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.634434 11163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698e76971cae438590bc0895c41f9266" candidate_uuid: "9c08415addb64339a678077a5970c4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" is_pre_election: true
14:22:27.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.635293 11163 raft_consensus.cc:2468] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c08415addb64339a678077a5970c4e0 in term 0.
14:22:27.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.635234 10812 leader_election.cc:304] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21245d28728c4865a9eca7be205d1a16, 9c08415addb64339a678077a5970c4e0; no voters: 
14:22:27.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.635918 11324 raft_consensus.cc:2804] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:27.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.636222 11324 raft_consensus.cc:493] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:27.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.636520 11324 raft_consensus.cc:3060] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Advancing to term 1
14:22:27.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.641556 11324 raft_consensus.cc:515] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.643191 11324 leader_election.cc:290] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 21245d28728c4865a9eca7be205d1a16 (127.10.60.2:33545), 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:27.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.643836 11021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698e76971cae438590bc0895c41f9266" candidate_uuid: "9c08415addb64339a678077a5970c4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21245d28728c4865a9eca7be205d1a16"
14:22:27.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.644348 11021 raft_consensus.cc:3060] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Advancing to term 1
14:22:27.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.644636 11163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698e76971cae438590bc0895c41f9266" candidate_uuid: "9c08415addb64339a678077a5970c4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f3d90837b8457aaa49a7f96bd7c22a"
14:22:27.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.645148 11163 raft_consensus.cc:3060] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Advancing to term 1
14:22:27.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.649318 11021 raft_consensus.cc:2468] T 698e76971cae438590bc0895c41f9266 P 21245d28728c4865a9eca7be205d1a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c08415addb64339a678077a5970c4e0 in term 1.
14:22:27.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.650411 10812 leader_election.cc:304] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21245d28728c4865a9eca7be205d1a16, 9c08415addb64339a678077a5970c4e0; no voters: 
14:22:27.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.650950 11324 raft_consensus.cc:2804] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 1 FOLLOWER]: Leader election won for term 1
14:22:27.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.651360 11163 raft_consensus.cc:2468] T 698e76971cae438590bc0895c41f9266 P 21f3d90837b8457aaa49a7f96bd7c22a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c08415addb64339a678077a5970c4e0 in term 1.
14:22:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.657799 11324 raft_consensus.cc:697] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 9c08415addb64339a678077a5970c4e0, State: Running, Role: LEADER
14:22:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.658716 11324 consensus_queue.cc:237] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:27.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:27.672158 10524 catalog_manager.cc:5697] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c08415addb64339a678077a5970c4e0 (127.10.60.1). New cstate: current_term: 1 leader_uuid: "9c08415addb64339a678077a5970c4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } health_report { overall_health: UNKNOWN } } }
14:22:28.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.148878 11324 consensus_queue.cc:1048] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:28.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.186478 11324 consensus_queue.cc:1048] T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:22:28.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.253010 10524 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50912:
14:22:28.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
14:22:28.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:28.291451 10524 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af0965d93083480b99edbf309d5bd7e1 has no consensus state
14:22:28.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.312376 11001 tablet_service.cc:1511] Processing CreateTablet for tablet af0965d93083480b99edbf309d5bd7e1 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:28.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.313148 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0965d93083480b99edbf309d5bd7e1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:28.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.316105 10859 tablet_service.cc:1511] Processing CreateTablet for tablet af0965d93083480b99edbf309d5bd7e1 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:28.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.317231 10859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0965d93083480b99edbf309d5bd7e1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:28.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.317138 11143 tablet_service.cc:1511] Processing CreateTablet for tablet af0965d93083480b99edbf309d5bd7e1 (DEFAULT_TABLE table=replication_test_table [id=c019dfde3ff04f5ab790957932790fdb]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:22:28.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.318325 11143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0965d93083480b99edbf309d5bd7e1. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:28.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.332671 11353 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16: Bootstrap starting.
14:22:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.337998 11355 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0: Bootstrap starting.
14:22:28.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.340315 11353 tablet_bootstrap.cc:654] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16: Neither blocks nor log segments found. Creating new log.
14:22:28.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.343715 11354 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a: Bootstrap starting.
14:22:28.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.347810 11355 tablet_bootstrap.cc:654] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0: Neither blocks nor log segments found. Creating new log.
14:22:28.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:28.348467 10512 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet af0965d93083480b99edbf309d5bd7e1 (table replication_test_table [id=c019dfde3ff04f5ab790957932790fdb], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet af0965d93083480b99edbf309d5bd7e1 consensus state has no leader
14:22:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.353459 11354 tablet_bootstrap.cc:654] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a: Neither blocks nor log segments found. Creating new log.
14:22:28.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.362713 11355 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0: No bootstrap required, opened a new log
14:22:28.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.363474 11355 ts_tablet_manager.cc:1403] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
14:22:28.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.365561 11353 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16: No bootstrap required, opened a new log
14:22:28.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.365953 11353 ts_tablet_manager.cc:1403] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.005s
14:22:28.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.366777 11355 raft_consensus.cc:359] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.367635 11355 raft_consensus.cc:385] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:28.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.368034 11355 raft_consensus.cc:740] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c08415addb64339a678077a5970c4e0, State: Initialized, Role: FOLLOWER
14:22:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.368916 11355 consensus_queue.cc:260] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.371299 11353 raft_consensus.cc:359] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.373642 11353 raft_consensus.cc:385] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.373919 11353 raft_consensus.cc:740] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21245d28728c4865a9eca7be205d1a16, State: Initialized, Role: FOLLOWER
14:22:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.374284 11355 ts_tablet_manager.cc:1434] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
14:22:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.374616 11353 consensus_queue.cc:260] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.380625 11354 tablet_bootstrap.cc:492] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a: No bootstrap required, opened a new log
14:22:28.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.381318 11354 ts_tablet_manager.cc:1403] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.004s
14:22:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.384413 11353 ts_tablet_manager.cc:1434] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
14:22:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.386695 11354 raft_consensus.cc:359] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.388154 11354 raft_consensus.cc:385] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:28.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.388798 11354 raft_consensus.cc:740] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f3d90837b8457aaa49a7f96bd7c22a, State: Initialized, Role: FOLLOWER
14:22:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.390095 11354 consensus_queue.cc:260] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.394228 11354 ts_tablet_manager.cc:1434] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.006s
14:22:28.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.411234 10524 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4a4eb19dd5ae420390c5f926f3ff9280: replication_test_table [id=c019dfde3ff04f5ab790957932790fdb] alter complete (version 0)
14:22:28.434 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state READY
14:22:28.435 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state READY
14:22:28.435 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state READY
14:22:28.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.437700 11340 raft_consensus.cc:493] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:28.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.438292 11340 raft_consensus.cc:515] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.440 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.135.188:36123(127.9.135.188:36123)] handling channelInactive
14:22:28.440 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.135.190:41023(127.9.135.190:41023)] handling channelInactive
14:22:28.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state READY due to: connection closed
14:22:28.440 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state READY due to: connection closed
14:22:28.441 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:28.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.441304 11340 leader_election.cc:290] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c08415addb64339a678077a5970c4e0 (127.10.60.1:46175), 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:28.449 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
14:22:28.452 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
14:22:28.466 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.135.189:37257(127.9.135.189:37257)] handling channelInactive
14:22:28.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state READY due to: connection closed
14:22:28.467 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
14:22:28.467 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state READY
14:22:28.467 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state READY
14:22:28.467 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state READY
14:22:28.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.466794 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0965d93083480b99edbf309d5bd7e1" candidate_uuid: "21245d28728c4865a9eca7be205d1a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c08415addb64339a678077a5970c4e0" is_pre_election: true
14:22:28.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.467602 10879 raft_consensus.cc:2468] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21245d28728c4865a9eca7be205d1a16 in term 0.
14:22:28.468 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:28.468 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:28.469 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:28.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:28.469 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:28.471 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:22:28.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.469240 10956 leader_election.cc:304] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21245d28728c4865a9eca7be205d1a16, 9c08415addb64339a678077a5970c4e0; no voters: 
14:22:28.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.470114 11340 raft_consensus.cc:2804] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:28.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.470430 11340 raft_consensus.cc:493] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:28.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.470654 11340 raft_consensus.cc:3060] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 0 FOLLOWER]: Advancing to term 1
14:22:28.471 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
14:22:28.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.477114 11340 raft_consensus.cc:515] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.478 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:28.478 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:28.478 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:22:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.479746 11340 leader_election.cc:290] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [CANDIDATE]: Term 1 election: Requested vote from peers 9c08415addb64339a678077a5970c4e0 (127.10.60.1:46175), 21f3d90837b8457aaa49a7f96bd7c22a (127.10.60.3:34579)
14:22:28.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.481679 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0965d93083480b99edbf309d5bd7e1" candidate_uuid: "21245d28728c4865a9eca7be205d1a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c08415addb64339a678077a5970c4e0"
14:22:28.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.482172 10879 raft_consensus.cc:3060] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 0 FOLLOWER]: Advancing to term 1
14:22:28.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.485015 11163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0965d93083480b99edbf309d5bd7e1" candidate_uuid: "21245d28728c4865a9eca7be205d1a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" is_pre_election: true
14:22:28.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.485550 11163 raft_consensus.cc:2468] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21245d28728c4865a9eca7be205d1a16 in term 0.
14:22:28.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.488269 11163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0965d93083480b99edbf309d5bd7e1" candidate_uuid: "21245d28728c4865a9eca7be205d1a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f3d90837b8457aaa49a7f96bd7c22a"
14:22:28.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.488801 11163 raft_consensus.cc:3060] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 0 FOLLOWER]: Advancing to term 1
14:22:28.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.489280 10879 raft_consensus.cc:2468] T af0965d93083480b99edbf309d5bd7e1 P 9c08415addb64339a678077a5970c4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21245d28728c4865a9eca7be205d1a16 in term 1.
14:22:28.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.490490 10956 leader_election.cc:304] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21245d28728c4865a9eca7be205d1a16, 9c08415addb64339a678077a5970c4e0; no voters: 
14:22:28.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.491264 11340 raft_consensus.cc:2804] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 1 FOLLOWER]: Leader election won for term 1
14:22:28.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.495995 11163 raft_consensus.cc:2468] T af0965d93083480b99edbf309d5bd7e1 P 21f3d90837b8457aaa49a7f96bd7c22a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21245d28728c4865a9eca7be205d1a16 in term 1.
14:22:28.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.499882 11340 raft_consensus.cc:697] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [term 1 LEADER]: Becoming Leader. State: Replica: 21245d28728c4865a9eca7be205d1a16, State: Running, Role: LEADER
14:22:28.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.500854 11340 consensus_queue.cc:237] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } }
14:22:28.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:28.554121 10526 catalog_manager.cc:5697] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21245d28728c4865a9eca7be205d1a16 (127.10.60.2). New cstate: current_term: 1 leader_uuid: "21245d28728c4865a9eca7be205d1a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21245d28728c4865a9eca7be205d1a16" member_type: VOTER last_known_addr { host: "127.10.60.2" port: 33545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 } health_report { overall_health: UNKNOWN } } }
14:22:28.731 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:22:28.735 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:22:28.735 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:22:28.735 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:22:28.735 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:22:28.738 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:22:28.976 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:22:28.976 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:22:28.976 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:22:28.976 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:22:28.977 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:22:28.977 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:22:28.978 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:22:29.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:29.013245 11340 consensus_queue.cc:1048] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c08415addb64339a678077a5970c4e0" member_type: VOTER last_known_addr { host: "127.10.60.1" port: 46175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:29.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:29.064119 11374 consensus_queue.cc:1048] T af0965d93083480b99edbf309d5bd7e1 P 21245d28728c4865a9eca7be205d1a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f3d90837b8457aaa49a7f96bd7c22a" member_type: VOTER last_known_addr { host: "127.10.60.3" port: 34579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:29.300 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:22:29.375 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:22:29.375 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:22:29.375 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:22:29.391 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:22:30.052 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:22:30.201 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:22:30.220 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:22:30.242 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:22:30.254 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:22:30.270 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:22:30.356 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:22:30.360 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:22:30.360 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:22:30.365 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:22:30.366 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:22:30.367 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:22:30.367 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:22:30.368 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:22:30.370 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:22:30.370 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:22:30.371 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:22:30.372 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:22:30.372 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:22:30.372 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:22:30.372 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:22:30.372 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:22:30.374 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:22:30.374 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:22:30.374 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:22:30.375 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:22:30.375 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:22:30.376 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:22:30.376 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:22:30.376 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:22:30.386 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_b37b494b49005698fcd07b7cf0f71c85/blobStorage
14:22:30.390 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:35543 - max concurrent requests: 50 - max backlog: 1000
14:22:30.396 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_b37b494b49005698fcd07b7cf0f71c85/blobStorage
14:22:30.398 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_b37b494b49005698fcd07b7cf0f71c85/blobStorage
14:22:30.399 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:22:30.402 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 3668177f-517e-405a-935d-758299549e72
14:22:30.423 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
14:22:30.426 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-cccc8634-f615-4dee-a943-6196b1a662d0
14:22:30.436 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-f44628b1-7042-416e-9c26-908d68c03ec9
14:22:30.520 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:22:30.543 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:22:30.543 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:22:30.545 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:22:30.600 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:22:30.618 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_0 .
14:22:30.680 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
14:22:30.682 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-be4413fc-732a-4bf4-970b-08fb5b7cbc3e
14:22:30.754 [INFO - main] (RestServerEndpoint.java:567) Upload directory /tmp/flink-web-upload does not exist. 
14:22:30.755 [INFO - main] (RestServerEndpoint.java:592) Created directory /tmp/flink-web-upload for file uploads.
14:22:30.758 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:22:30.760 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:22:31.096 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:22:31.096 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:22:31.251 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:38993
14:22:31.251 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:22:31.254 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:38993 was granted leadership with leaderSessionID=550471a1-c771-4cb5-b2db-c8b7e9480a2c
14:22:31.254 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:38993 , session=550471a1-c771-4cb5-b2db-c8b7e9480a2c
14:22:31.268 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:22:31.268 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:22:31.268 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:22:31.270 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 15c42f79-320f-49c6-93c6-242ef3a2843c. Creating new DispatcherLeaderProcess.
14:22:31.271 [INFO - pool-11-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id a1fb201e-a2de-484a-8ef6-692b9afbc77c.
14:22:31.276 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:22:31.277 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:22:31.279 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:22:31.279 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:22:31.295 [INFO - pool-11-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_1 .
14:22:31.312 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_2 .
14:22:31.331 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
14:22:31.339 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:22:31.340 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:22:31.341 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:22:31.341 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:22:31.342 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_1 , session=a1fb201e-a2de-484a-8ef6-692b9afbc77c
14:22:31.344 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_1(8ef6692b9afbc77ca1fb201ea2de484a).
14:22:31.344 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_2 , session=15c42f79-320f-49c6-93c6-242ef3a2843c
14:22:31.376 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:22:31.385 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID 3668177f-517e-405a-935d-758299549e72 (pekko://flink/user/rpc/taskmanager_0) at ResourceManager
14:22:31.386 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.388 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_1 under registration id 5870650fded2fc070c9b0c3503df6244.
14:22:31.388 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.389 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor 3668177f-517e-405a-935d-758299549e72 under 5870650fded2fc070c9b0c3503df6244 at the slot manager.
14:22:31.400 [INFO - flink-pekko.actor.default-dispatcher-9] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-d754db15cc0c9bfa72479ca905ecb22a'.
14:22:31.402 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job d754db15cc0c9bfa72479ca905ecb22a was granted leadership with leader id 5188775a-5e9f-4eb2-a6a9-50a5f312ec80. Creating new JobMasterServiceProcess.
14:22:31.420 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 .
14:22:31.431 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.461 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.501 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 879fed5d7debbbe49a0a590b81e023af for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:31.542 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.543 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:22:31.595 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 3 ms, total 4 pipelined regions currently.
14:22:31.604 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c18069a
14:22:31.604 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:22:31.605 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:22:31.654 [INFO - jobmanager-io-thread-1] (FileSystem.java:1139) Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
14:22:31.693 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:22:31.703 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@4395f29d for Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a).
14:22:31.716 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_3 , session=5188775a-5e9f-4eb2-a6a9-50a5f312ec80
14:22:31.718 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (d754db15cc0c9bfa72479ca905ecb22a) under job master id a6a950a5f312ec805188775a5e9f4eb2.
14:22:31.721 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:22:31.727 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:31.729 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:22:31.729 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state CREATED to RUNNING.
14:22:31.745 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:31.748 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:22:31.750 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:31.762 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.135.188:36123(127.9.135.188:36123)] Successfully connected to peer
14:22:31.798 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:31.801 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.188
14:22:31.817 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.135.190:41023(127.9.135.190:41023)] Successfully connected to peer
14:22:31.824 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.135.189:37257(127.9.135.189:37257)] Successfully connected to peer
14:22:31.826 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:22:31.827 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:22:31.839 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.190
14:22:31.841 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:22:31.843 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_1(8ef6692b9afbc77ca1fb201ea2de484a)
14:22:31.843 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.846 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.189
14:22:31.852 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:22:31.853 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd9035c6a, L:/127.0.0.1:44264 - R:/127.9.135.188:36123] using SASL/PLAIN
14:22:31.854 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager a6a950a5f312ec805188775a5e9f4eb2@pekko://flink/user/rpc/jobmanager_3 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:31.861 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.864 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.870 [DEBUG - kudu-nio-0] (NetUtil.java:139) Resolved '127.9.135.188' into [/127.9.135.188] in 2040679ns
14:22:31.870 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:31.870 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=137), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [132ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: OK, deferred=null) after lookup
14:22:31.871 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x91a22492, L:/127.0.0.1:45530 - R:/127.9.135.190:41023] using SASL/PLAIN
14:22:31.874 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:31.881 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1015) Registered job manager a6a950a5f312ec805188775a5e9f4eb2@pekko://flink/user/rpc/jobmanager_3 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:31.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:31.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:31.882 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:31.888 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc7e13139, L:/127.0.0.1:46716 - R:/127.9.135.189:37257] using SASL/PLAIN
14:22:31.890 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:31.901 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:31.904 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 8ef6692b9afbc77ca1fb201ea2de484a.
14:22:31.906 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:22:31.906 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:31.908 [DEBUG - main] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:31.911 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:31.911 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:31.911 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:31.931 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.932 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:31.942 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8eabb5ef, L:/127.0.0.1:44740 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:31.947 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.60
14:22:31.948 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:31.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=76), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [59ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, deferred=null) after lookup
14:22:31.955 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.958 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:31.961 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:31.970 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdf5891fa, L:/127.0.0.1:33316 - R:/127.10.60.60:46387] using SASL/PLAIN
14:22:31.974 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xce09c297, L:/127.0.0.1:47788 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:31.979 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job d754db15cc0c9bfa72479ca905ecb22a
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 3668177f-517e-405a-935d-758299549e72
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:22:31.987 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9d480502e0cdd9d8883744c6b05e846a from 3668177f-517e-405a-935d-758299549e72 for job d754db15cc0c9bfa72479ca905ecb22a with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:31.987 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 698e76971cae438590bc0895c41f9266 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:31.987 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet af0965d93083480b99edbf309d5bd7e1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:31.988 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=698e76971cae438590bc0895c41f9266@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545),21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=af0965d93083480b99edbf309d5bd7e1@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)[L],21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:31.990 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 9d480502e0cdd9d8883744c6b05e846a for job d754db15cc0c9bfa72479ca905ecb22a from resource manager with leader id 8ef6692b9afbc77ca1fb201ea2de484a.
14:22:31.991 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 9d480502e0cdd9d8883744c6b05e846a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:31.995 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2e66b69a1b92434a74d33f57918b8903 from 3668177f-517e-405a-935d-758299549e72 for job d754db15cc0c9bfa72479ca905ecb22a with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:31.995 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.60.62:34681, [5ms] Sub RPC GetTableLocations: received response from server master-127.10.60.62:34681: OK, deferred=null)) after lookup
14:22:31.996 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d3328e0b20c8307c13567fb6051cf936 from 3668177f-517e-405a-935d-758299549e72 for job d754db15cc0c9bfa72479ca905ecb22a with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:31.997 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job d754db15cc0c9bfa72479ca905ecb22a for job leader monitoring.
14:22:31.997 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f182fce0edf1da65a6d97afd27db425c from 3668177f-517e-405a-935d-758299549e72 for job d754db15cc0c9bfa72479ca905ecb22a with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:32.000 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_3 with leader id 5188775a-5e9f-4eb2-a6a9-50a5f312ec80.
14:22:32.000 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 2e66b69a1b92434a74d33f57918b8903 for job d754db15cc0c9bfa72479ca905ecb22a from resource manager with leader id 8ef6692b9afbc77ca1fb201ea2de484a.
14:22:32.000 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 2e66b69a1b92434a74d33f57918b8903 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:32.000 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request d3328e0b20c8307c13567fb6051cf936 for job d754db15cc0c9bfa72479ca905ecb22a from resource manager with leader id 8ef6692b9afbc77ca1fb201ea2de484a.
14:22:32.001 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for d3328e0b20c8307c13567fb6051cf936 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:32.001 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request f182fce0edf1da65a6d97afd27db425c for job d754db15cc0c9bfa72479ca905ecb22a from resource manager with leader id 8ef6692b9afbc77ca1fb201ea2de484a.
14:22:32.001 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for f182fce0edf1da65a6d97afd27db425c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:22:32.002 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:22:32.007 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_3 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:32.007 [DEBUG - main] (Connection.java:748) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] connecting to peer
14:22:32.008 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:32.010 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] Successfully connected to peer
14:22:32.013 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job d754db15cc0c9bfa72479ca905ecb22a.
14:22:32.021 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:22:32.022 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:22:32.026 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:22:32.030 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.040 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x5c1a056f, L:/127.0.0.1:39914 - R:/127.10.60.1:46175] using TOKEN/null
14:22:32.044 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:32.046 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:22:32.046 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:22:32.049 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:84) StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
14:22:32.049 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:22:32.050 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:22:32.051 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:22:32.054 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:22:32.054 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:22:32.063 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id d754db15cc0c9bfa72479ca905ecb22a
14:22:32.065 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:22:32.085 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.086 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.087 [DEBUG - main] (Connection.java:748) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] connecting to peer
14:22:32.090 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] Successfully connected to peer
14:22:32.091 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:22:32.105 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:22:32.114 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:22:32.120 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:22:32.121 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.127 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x09d77ef5, L:/127.0.0.1:35008 - R:/127.10.60.2:33545] using TOKEN/null
14:22:32.128 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:22:32.131 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:22:32.132 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:22:32.139 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:22:32.140 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:22:32.146 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:22:32.146 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:22:32.150 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:22:32.154 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:22:32.162 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.162 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.163 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:22:32.163 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:22:32.163 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:22:32.163 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:22:32.164 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:22:32.164 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:22:32.193 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@75d765c
14:22:32.193 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:22:32.194 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2155c031
14:22:32.194 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:22:32.194 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:22:32.202 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:22:32.205 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d2b1afa
14:22:32.205 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:22:32.205 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:22:32.213 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:22:32.214 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:22:32.215 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:22:32.220 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.220 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.227 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:22:32.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fbac3be
14:22:32.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:22:32.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:22:32.229 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:22:32.234 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:22:32.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:22:32.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:22:32.237 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.237 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.296 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.297 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.307 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.312 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.370 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.371 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.379 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.379 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.381 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3775a34d
14:22:32.381 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e01a5d6
14:22:32.386 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ac14827
14:22:32.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@11c32fb7
14:22:32.442 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.442 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.449 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.449 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.449 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.449 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.450 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.458 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:32.459 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:32.460 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:32.460 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:32.461 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:32.463 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.464 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:32.465 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:32.469 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:32.470 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:32.478 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:32.495 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:32.503 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.504 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.506 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:32.506 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.507 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.507 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:32.509 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:32.513 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe52092bf, L:/127.0.0.1:44750 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:32.521 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:32.522 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0aa9817a, L:/127.0.0.1:47794 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:32.523 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.523 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.531 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:22:32.542 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:22:32.543 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.546 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:32.546 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=96), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [66ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: OK, deferred=null) after lookup
14:22:32.550 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.553 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.554 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ff1a05d
14:22:32.554 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3797ca48, L:/127.0.0.1:44756 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:32.566 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.568 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:32.568 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:32.590 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:22:32.595 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:32.605 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:32.606 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:32.614 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:22:32.616 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.60.62:34681(127.10.60.62:34681)] Successfully connected to peer
14:22:32.617 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:22:32.618 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.60.61:42317(127.10.60.61:42317)] Successfully connected to peer
14:22:32.637 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:32.637 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=186), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, deferred=null) after lookup
14:22:32.640 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.641 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.641 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:32.643 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.648 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.649 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@495b1efa
14:22:32.651 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:22:32.654 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:22:32.655 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.655 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.671 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:32.674 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:32.688 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:32.691 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.60
14:22:32.692 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.62
14:22:32.695 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.61
14:22:32.702 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x66576429, L:/127.0.0.1:47808 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:32.706 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:22:32.719 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.60.60:46387(127.10.60.60:46387)] Successfully connected to peer
14:22:32.719 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.719 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.722 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.60.60
14:22:32.725 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.732 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.741 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.742 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7bee3836, L:/127.0.0.1:33336 - R:/127.10.60.60:46387] using SASL/PLAIN
14:22:32.743 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.745 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.748 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.751 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x94413a77, L:/127.0.0.1:44772 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:32.755 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x84e722f0, L:/127.0.0.1:33344 - R:/127.10.60.60:46387] using SASL/PLAIN
14:22:32.756 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.757 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.759 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.762 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0e6660ee, L:/127.0.0.1:44766 - R:/127.10.60.62:34681] using SASL/PLAIN
14:22:32.766 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:22:32.767 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='735dfbc245dbc76f5593da542a4625ee87b6db9649efbd9db853178e7fdb1313'}]
14:22:32.768 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x129c4a02, L:/127.0.0.1:33332 - R:/127.10.60.60:46387] using TOKEN/null
14:22:32.771 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xee70d4e3, L:/127.0.0.1:47816 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:32.773 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:32.774 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=323), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: OK, [314ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, deferred=null) after lookup
14:22:32.775 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x35fbebe1, L:/127.0.0.1:47820 - R:/127.10.60.61:42317] using SASL/PLAIN
14:22:32.776 [DEBUG - kudu-nio-0] (NetUtil.java:139) Resolved '127.10.60.62' into [/127.10.60.62] in 3619066ns
14:22:32.776 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:32.776 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=312), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: OK, [230ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: OK, deferred=null) after lookup
14:22:32.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.792 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.792 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16ebfd96
14:22:32.794 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.794 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.801 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.802 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.803 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.805 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:32.805 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e40d607
14:22:32.809 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:22:32.814 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.815 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.817 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cdfd86c61fffed69f3d2c6e1835781f3220641197023a371932a426f6600b70c'}]
14:22:32.819 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:32.825 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xce38bcd6, L:/127.0.0.1:33360 - R:/127.10.60.60:46387] using TOKEN/null
14:22:32.828 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:22:32.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:22:32.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:22:32.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:22:32.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:22:32.839 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:22:32.851 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:22:32.863 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:22:32.871 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299994, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}]
14:22:32.872 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.872 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.881 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.881 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.883 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:22:32.888 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:22:32.888 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:22:32.903 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] connecting to peer
14:22:32.904 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:22:32.905 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655)[L],b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}]
14:22:32.914 [DEBUG - kudu-nio-0] (Connection.java:757) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] Successfully connected to peer
14:22:32.923 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.131
14:22:32.930 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] connecting to peer
14:22:32.942 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.942 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:32.950 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:32.950 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:32.961 [DEBUG - kudu-nio-0] (Connection.java:757) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] Successfully connected to peer
14:22:32.967 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:32.971 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.131
14:22:32.983 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xda17eb86, L:/127.0.0.1:44952 - R:/127.9.135.131:34859] using SASL/PLAIN
14:22:33.002 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:33.007 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.007 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.010 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa8f234dd, L:/127.0.0.1:44962 - R:/127.9.135.131:34859] using SASL/PLAIN
14:22:33.014 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.014 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.034 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7287251565498368001) for scanner KuduScanner(table=replication_test_table, tablet=50cb35d3b02948878cf1ff38928ff1f1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.036 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7287251565498368001) for scanner KuduScanner(table=replication_test_table, tablet=51b44ae8905d442d8b20115e40f20fed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.040 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [cdfd86c61fffed69f3d2c6e1835781f3220641197023a371932a426f6600b70c]
14:22:33.041 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [735dfbc245dbc76f5593da542a4625ee87b6db9649efbd9db853178e7fdb1313]
14:22:33.043 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:22:33.043 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:22:33.053 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114153033 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:33.071 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.072 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.081 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.082 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.139 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.140 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.147 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.148 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.179 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 698e76971cae438590bc0895c41f9266 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:33.179 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af0965d93083480b99edbf309d5bd7e1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.179 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=698e76971cae438590bc0895c41f9266@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545),21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=af0965d93083480b99edbf309d5bd7e1@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)[L],21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.180 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af0965d93083480b99edbf309d5bd7e1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.181 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=af0965d93083480b99edbf309d5bd7e1@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)[L],21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.191 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4367ac7, flushNotification=Deferred@2102960972(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:22:33.191 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@40b8848e, flushNotification=Deferred@1323418790(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:22:33.195 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] connecting to peer
14:22:33.196 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] connecting to peer
14:22:33.204 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.208 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.216 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.216 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.236 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] Successfully connected to peer
14:22:33.242 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] Successfully connected to peer
14:22:33.277 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.285 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.286 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.286 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:33.291 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x14f8ce80, L:/127.0.0.1:35014 - R:/127.10.60.2:33545] using TOKEN/null
14:22:33.296 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:33.304 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xb0ca8b67, L:/127.0.0.1:39926 - R:/127.10.60.1:46175] using TOKEN/null
14:22:33.344 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.344 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.351 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.351 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.416 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.416 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.429 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.430 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:33.457886 11522 log.cc:927] Time spent T 698e76971cae438590bc0895c41f9266 P 9c08415addb64339a678077a5970c4e0: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
14:22:33.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:33.470465 10956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.60.1:46175, user_credentials={real_user=slave}} blocked reactor thread for 76272.2us
14:22:33.519 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [735dfbc245dbc76f5593da542a4625ee87b6db9649efbd9db853178e7fdb1313]
14:22:33.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.521 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.525 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 735dfbc245dbc76f5593da542a4625ee87b6db9649efbd9db853178e7fdb1313 finished by subtask 0; deferring removal (restored in pending)
14:22:33.525 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:22:33.525 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:22:33.526 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] disconnecting while in state READY
14:22:33.526 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:33.533 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.533 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.592 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.593 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.601 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.601 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.611 [DEBUG - kudu-nio-0] (Connection.java:239) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] handling channelInactive
14:22:33.611 [DEBUG - kudu-nio-0] (Connection.java:709) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] cleaning up while in state READY due to: connection closed
14:22:33.612 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:22:33.613 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:22:33.621 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cdfd86c61fffed69f3d2c6e1835781f3220641197023a371932a426f6600b70c]
14:22:33.622 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:22:33.622 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:22:33.622 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] disconnecting while in state READY
14:22:33.623 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cdfd86c61fffed69f3d2c6e1835781f3220641197023a371932a426f6600b70c finished by subtask 2; deferring removal (restored in pending)
14:22:33.623 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:33.667 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.675 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.685 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.685 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.694 [DEBUG - kudu-nio-0] (Connection.java:239) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] handling channelInactive
14:22:33.694 [DEBUG - kudu-nio-0] (Connection.java:709) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] cleaning up while in state READY due to: connection closed
14:22:33.695 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:22:33.695 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:22:33.744 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.744 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.753 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.753 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.763 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job d754db15cc0c9bfa72479ca905ecb22a (2244 bytes, checkpointDuration=699 ms, finalizationTime=31 ms).
14:22:33.765 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 235
14:22:33.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:22:33.769 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 735dfbc245dbc76f5593da542a4625ee87b6db9649efbd9db853178e7fdb1313 from pending
14:22:33.770 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split cdfd86c61fffed69f3d2c6e1835781f3220641197023a371932a426f6600b70c from pending
14:22:33.770 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 2 finished splits from enumerator state
14:22:33.773 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114153765 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:33.778 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3926a261, flushNotification=Deferred@116305782(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:22:33.782 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=252, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2a4ad313, flushNotification=Deferred@1511015926(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:22:33.847 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.847 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.861 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:33.864 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:33.869 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:33.872 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:33.873 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=98 ms, finalizationTime=10 ms).
14:22:33.875 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:22:33.876 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:33.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.877 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.881 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 698e76971cae438590bc0895c41f9266 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:33.881 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af0965d93083480b99edbf309d5bd7e1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.882 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=698e76971cae438590bc0895c41f9266@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545),21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=af0965d93083480b99edbf309d5bd7e1@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)[L],21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.885 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:33.888 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c019dfde3ff04f5ab790957932790fdb
14:22:33.891 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:33.891 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.892 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.892 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.135.188:36123, [3ms] Sub RPC GetTableLocations: received response from server master-127.9.135.188:36123: OK, deferred=null)) after lookup
14:22:33.899 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=51b44ae8905d442d8b20115e40f20fed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.900 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 51b44ae8905d442d8b20115e40f20fed for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.939 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50cb35d3b02948878cf1ff38928ff1f1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.939 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 50cb35d3b02948878cf1ff38928ff1f1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.944 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 698e76971cae438590bc0895c41f9266 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:33.944 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af0965d93083480b99edbf309d5bd7e1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:33.944 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=698e76971cae438590bc0895c41f9266@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545),21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=af0965d93083480b99edbf309d5bd7e1@[21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)[L],21f3d90837b8457aaa49a7f96bd7c22a(127.10.60.3:34579),9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:33.944 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.60.62:34681, [3ms] Sub RPC GetTableLocations: received response from server master-127.10.60.62:34681: OK, deferred=null)) after lookup
14:22:33.957 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.958 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.965 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.966 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:33.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=51b44ae8905d442d8b20115e40f20fed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 51b44ae8905d442d8b20115e40f20fed for partition [0x80000000, 0x80000032) with scanner id null
14:22:33.993 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50cb35d3b02948878cf1ff38928ff1f1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:33.993 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 50cb35d3b02948878cf1ff38928ff1f1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:34.004 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=698e76971cae438590bc0895c41f9266, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:34.005 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 698e76971cae438590bc0895c41f9266 for partition [0x80000000, 0x80000032) with scanner id null
14:22:34.016 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af0965d93083480b99edbf309d5bd7e1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:34.016 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet af0965d93083480b99edbf309d5bd7e1 for partition [0x80000064, 0x800000C8) with scanner id null
14:22:34.018 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state READY
14:22:34.018 [DEBUG - main] (Connection.java:575) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] disconnecting while in state READY
14:22:34.018 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state READY
14:22:34.018 [DEBUG - main] (Connection.java:575) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] disconnecting while in state READY
14:22:34.018 [DEBUG - main] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state READY
14:22:34.019 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:34.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:34.020 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:34.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:34.021 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:34.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:34.023 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] handling channelInactive
14:22:34.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] cleaning up while in state READY due to: connection closed
14:22:34.024 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:34.025 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:22:34.026 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:22:34.026 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
14:22:34.027 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:22:34.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114154030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:34.045 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] handling channelInactive
14:22:34.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] cleaning up while in state READY due to: connection closed
14:22:34.045 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
14:22:34.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.047729 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10768
14:22:34.051 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
14:22:34.054 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:22:34.095 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] handling channelInactive
14:22:34.096 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] cleaning up while in state READY due to: connection closed
14:22:34.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.093196 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10931
14:22:34.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.138239 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 11071
14:22:34.138 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] handling channelInactive
14:22:34.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] cleaning up while in state READY due to: connection closed
14:22:34.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:34.174099 10511 connection.cc:582] server connection from 127.10.60.3:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:22:34.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:34.175127 10669 connection.cc:582] server connection from 127.10.60.3:34197 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:22:34.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.176626 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10493
14:22:34.205 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:34.205 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:34.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:34.205 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:34.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:34.206 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.60.62:34681(127.10.60.62:34681)] handling channelInactive
14:22:34.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.206730 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10563
14:22:34.214 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state READY due to: connection closed
14:22:34.238 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:34.238 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:34.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:34.239 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:34.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:34.239 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.60.61:42317(127.10.60.61:42317)] handling channelInactive
14:22:34.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:34.240 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state READY due to: connection closed
14:22:34.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:34.242115 10480 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10639
14:22:34.269 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:34.269 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:34.269 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:34.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:34.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:34.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:34.271 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.60.60:46387(127.10.60.60:46387)] handling channelInactive
14:22:34.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state READY due to: connection closed
14:22:34.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114154530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:34.580 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=41 ms, finalizationTime=7 ms).
14:22:34.581 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:22:34.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:34.943929  9989 debug-util.cc:398] Leaking SignalData structure 0x7b08000afbe0 after lost signal to thread 9920
14:22:34.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:34.944944  9989 debug-util.cc:398] Leaking SignalData structure 0x7b0800098440 after lost signal to thread 9992
14:22:35.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114155031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:35.058 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
14:22:35.062 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:22:35.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114155530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:35.559 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=24 ms, finalizationTime=4 ms).
14:22:35.563 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:22:35.744 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e19ca4dde081409b893f0b30503e7625
14:22:35.753 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 51b44ae8905d442d8b20115e40f20fed for table 'replication_test_table' with partition [0x80000000, 0x80000032)
14:22:35.753 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 50cb35d3b02948878cf1ff38928ff1f1 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:22:35.753 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)[L],fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:22:35.757 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0579e891e59f3b5e97cb230970f51d65e01cd28e8cc7e2d5d0a3ad0cfc60ef81'}]
14:22:35.760 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:35.761 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='55f42cfaa59bf9b45492366c26e9886c9b7ed1f2368230e369edd5f546c3ee4d'}]
14:22:35.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:35.770 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:22:35.771 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=51b44ae8905d442d8b20115e40f20fed@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655),b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)[L]]}]
14:22:35.777 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:22:35.780 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=50cb35d3b02948878cf1ff38928ff1f1@[3c968dd33116421ebd3ac5c09bb77731(127.9.135.129:36655)[L],b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783),fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)]}]
14:22:35.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] connecting to peer
14:22:35.796 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] connecting to peer
14:22:35.807 [DEBUG - kudu-nio-0] (Connection.java:757) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] Successfully connected to peer
14:22:35.826 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.131
14:22:35.853 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:35.860 [DEBUG - kudu-nio-0] (Connection.java:757) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] Successfully connected to peer
14:22:35.863 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1e8c0f79, L:/127.0.0.1:44972 - R:/127.9.135.131:34859] using SASL/PLAIN
14:22:35.865 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.135.131
14:22:35.876 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:22:35.882 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251581878272001) for scanner KuduScanner(table=replication_test_table, tablet=51b44ae8905d442d8b20115e40f20fed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:35.883 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [0579e891e59f3b5e97cb230970f51d65e01cd28e8cc7e2d5d0a3ad0cfc60ef81]
14:22:35.883 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0579e891e59f3b5e97cb230970f51d65e01cd28e8cc7e2d5d0a3ad0cfc60ef81]
14:22:35.884 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:22:35.884 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:22:35.885 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] disconnecting while in state READY
14:22:35.885 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0579e891e59f3b5e97cb230970f51d65e01cd28e8cc7e2d5d0a3ad0cfc60ef81 finished by subtask 3; deferring removal (restored in pending)
14:22:35.885 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:35.887 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0bc8b18b, L:/127.0.0.1:44978 - R:/127.9.135.131:34859] using SASL/PLAIN
14:22:35.906 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251581878272001) for scanner KuduScanner(table=replication_test_table, tablet=50cb35d3b02948878cf1ff38928ff1f1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:35.907 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [55f42cfaa59bf9b45492366c26e9886c9b7ed1f2368230e369edd5f546c3ee4d]
14:22:35.907 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [55f42cfaa59bf9b45492366c26e9886c9b7ed1f2368230e369edd5f546c3ee4d]
14:22:35.908 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:22:35.908 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:22:35.909 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 55f42cfaa59bf9b45492366c26e9886c9b7ed1f2368230e369edd5f546c3ee4d finished by subtask 1; deferring removal (restored in pending)
14:22:35.910 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] disconnecting while in state READY
14:22:35.911 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:35.928 [DEBUG - kudu-nio-0] (Connection.java:239) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] handling channelInactive
14:22:35.928 [DEBUG - kudu-nio-0] (Connection.java:709) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] cleaning up while in state READY due to: connection closed
14:22:35.929 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:22:35.929 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:22:35.946 [DEBUG - kudu-nio-0] (Connection.java:239) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] handling channelInactive
14:22:35.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] cleaning up while in state READY due to: connection closed
14:22:35.946 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:22:35.947 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:22:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:35Z chronyd exiting
14:22:36.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114156031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:36.047 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job d754db15cc0c9bfa72479ca905ecb22a (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
14:22:36.048 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:22:36.048 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 55f42cfaa59bf9b45492366c26e9886c9b7ed1f2368230e369edd5f546c3ee4d from pending
14:22:36.048 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 0579e891e59f3b5e97cb230970f51d65e01cd28e8cc7e2d5d0a3ad0cfc60ef81 from pending
14:22:36.048 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 2 finished splits from enumerator state
14:22:36.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114156530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:36.557 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
14:22:36.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:22:37.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114157030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:37.072 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=37 ms, finalizationTime=4 ms).
14:22:37.077 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:22:37.124 [DEBUG - main] (Connection.java:575) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] disconnecting while in state READY
14:22:37.124 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state READY
14:22:37.125 [DEBUG - main] (Connection.java:575) [peer b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)] disconnecting while in state READY
14:22:37.125 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state READY
14:22:37.125 [DEBUG - main] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state READY
14:22:37.125 [DEBUG - kudu-nio-3] (Connection.java:239) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] handling channelInactive
14:22:37.125 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.135.190:41023(127.9.135.190:41023)] handling channelInactive
14:22:37.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer fe7cc136039d4f84b96ca00654e80bad(127.9.135.131:34859)] cleaning up while in state READY due to: connection closed
14:22:37.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state READY due to: connection closed
14:22:37.126 [DEBUG - kudu-nio-4] (Connection.java:239) [peer b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)] handling channelInactive
14:22:37.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer b87306fca0b04ad6ba2642cf571feb46(127.9.135.130:34783)] cleaning up while in state READY due to: connection closed
14:22:37.126 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.135.189:37257(127.9.135.189:37257)] handling channelInactive
14:22:37.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state READY due to: connection closed
14:22:37.129 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:37.131 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:22:37.131 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
14:22:37.132 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
14:22:37.132 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:22:37.134 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.135.188:36123(127.9.135.188:36123)] handling channelInactive
14:22:37.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state READY due to: connection closed
14:22:37.134 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
14:22:37.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.135629  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10056
14:22:37.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.194988  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10191
14:22:37.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:37.228615 10358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.135.129:36655: connect: Connection refused (error 111)
14:22:37.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:37.245236 10358 consensus_peers.cc:597] T 51b44ae8905d442d8b20115e40f20fed P fe7cc136039d4f84b96ca00654e80bad -> Peer 3c968dd33116421ebd3ac5c09bb77731 (127.9.135.129:36655): Couldn't send request to peer 3c968dd33116421ebd3ac5c09bb77731. Status: Network error: Client connection negotiation failed: client connection to 127.9.135.129:36655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:22:37.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.247265  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 10338
14:22:37.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.283839  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 9770
14:22:37.313 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.135.190:41023(127.9.135.190:41023)] handling channelInactive
14:22:37.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state READY due to: connection closed
14:22:37.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.315559  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 9840
14:22:37.343 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.135.189:37257(127.9.135.189:37257)] handling channelInactive
14:22:37.343 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state READY due to: connection closed
14:22:37.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:37.343853  9758 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 9915
14:22:37.373 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.135.188:36123(127.9.135.188:36123)] handling channelInactive
14:22:37.373 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state READY due to: connection closed
14:22:37.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114157531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:37.549 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=16 ms, finalizationTime=2 ms).
14:22:37.553 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:22:37.733 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.735 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.9.135.188:36123(127.9.135.188:36123) for tablet Kudu Master: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.756 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.757 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.758 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.758 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.758 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.759 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.761 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.761 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.762 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.764 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.776 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.778 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.779 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.779 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.779 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.779 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.779 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.779 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.796 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.797 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.797 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.797 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.798 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.798 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.798 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.799 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.800 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.800 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.800 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.801 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.816 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.817 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.817 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.818 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.856 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.857 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.857 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.857 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.858 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.858 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.859 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.916 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.917 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.918 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:37.919 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:37.997 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:37.998 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:37.998 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.998 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.998 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:37.998 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:37.999 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.999 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:37.999 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.000 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.000 [WARN - pool-12-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:38.016 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:38.017 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:38.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.017 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:38.018 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.018 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.018 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.018 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.018 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.019 [WARN - pool-12-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:38.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114158030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:38.048 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=16 ms, finalizationTime=2 ms).
14:22:38.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:22:38.297 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:38.299 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:38.299 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.299 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.299 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:38.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:38.300 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:38.301 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.301 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:38.301 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:38Z chronyd exiting
14:22:38.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114158530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:38.543 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:22:38.545 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:22:39.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114159030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:39.043 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:22:39.044 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:22:39.216 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:39.217 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:39.218 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:39.218 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:39.218 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:39.218 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:39.218 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:39.218 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:39.219 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:39.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:39.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:39.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:39.219 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
.14:22:39.518 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114159518
14:22:39.518 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114159518
14:22:39.521 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:22:39.524 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:22:39.525 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:22:39.525 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:22:39.525 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:22:39.525 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:22:39.528 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:22:39.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114159530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:39.546 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:22:39.547 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:22:39.842 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:39.842 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:22:39.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:39.845288 11598 mini_oidc.cc:150] Starting JWKS server
14:22:39.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:39.848141 11598 webserver.cc:533] Webserver started at http://127.0.0.1:34213/ using document root <none> and password file <none>
14:22:39.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:39.848476 11598 mini_oidc.cc:186] Starting OIDC Discovery server
14:22:39.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:39.849977 11598 webserver.cc:533] Webserver started at http://127.0.0.1:32883/ using document root <none> and password file <none>
14:22:39.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:39Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:22:39.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:39Z Disabled control of system clock
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:39.907876 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/logs
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data/info.pb
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.190:41547
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.190
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json with env {}
14:22:40.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114160030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:40.046 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:22:40.048 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:22:40.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.211918 11610 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:40.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.212580 11610 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:40.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.213157 11610 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:40.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.243737 11610 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:40.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.244086 11610 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:40.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.244494 11610 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.244838 11610 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.245173 11610 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.245415 11610 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34213/jwks.json
14:22:40.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:40.279428 11610 master_runner.cc:387] Master server non-default flags:
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.190:41547
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data/info.pb
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.190
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/logs
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:40.281168 11610 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:40.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:40.283324 11610 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:40.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.295679 11616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:40.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114160530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:40.562 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=31 ms, finalizationTime=1 ms).
14:22:40.564 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:22:40.716 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:40.717 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:40.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:40.718 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:40.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:40.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:40.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:40.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:40.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:40.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:40.727 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:40.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:40.727 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:41.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114161031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:41.056 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:22:41.058 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:22:41.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114161530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:41.558 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
14:22:41.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:22:42.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:40.296144 11617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:42.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.012389 11610 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.717s	user 0.598s	sys 1.118s
14:22:42.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:41.698115 11615 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 11610
14:22:42.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.014102 11610 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.719s	user 0.599s	sys 1.119s
14:22:42.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.014820 11619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:42.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.017234 11618 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1717 milliseconds
14:22:42.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.017266 11610 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:42.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.018522 11610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:42.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.020831 11610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:42.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.022243 11610 hybrid_clock.cc:648] HybridClock initialized: now 1779114162022204 us; error 34 us; skew 500 ppm
14:22:42.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.023030 11610 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:42.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.029186 11610 webserver.cc:533] Webserver started at http://127.11.83.190:40139/ using document root <none> and password file <none>
14:22:42.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.030228 11610 fs_manager.cc:362] Metadata directory not provided
14:22:42.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.030483 11610 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:42.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114162030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:42.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.031150 11610 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:42.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.038180 11610 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data/instance:
14:22:42.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39eed25e9baf450ea85c5d72a23b3dfa"
14:22:42.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:42 on dist-test-slave-1n46"
14:22:42.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.039914 11610 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal/instance:
14:22:42.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39eed25e9baf450ea85c5d72a23b3dfa"
14:22:42.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:42 on dist-test-slave-1n46"
14:22:42.044 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:22:42.045 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:22:42.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.050729 11610 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.002s
14:22:42.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.058076 11627 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:42.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.059258 11610 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.059638 11610 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39eed25e9baf450ea85c5d72a23b3dfa"
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:42 on dist-test-slave-1n46"
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.060055 11610 fs_report.cc:389] FS layout report
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data/data
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:42.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:42.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:42.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:42.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:42.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.115571 11610 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:42.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.116986 11610 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:42.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.117372 11610 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:42.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.187407 11610 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.190:41547
14:22:42.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.187465 11678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.190:41547 every 8 connection(s)
14:22:42.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.190366 11610 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/data/info.pb
14:22:42.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.195943 11679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:42.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.198875 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 11610
14:22:42.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.199370 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-0/wal/instance
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.202860 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/logs
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data/info.pb
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.189:34071
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.189
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:42.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json with env {}
14:22:42.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.206406 11679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } has no permanent_uuid. Determining permanent_uuid...
14:22:42.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.237847 11679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
14:22:42.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.240341 11631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.244720 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.294276 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 1
14:22:42.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.298678 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.367158 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 2
14:22:42.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.371034 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.462535 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 3
14:22:42.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.467195 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.502734 11681 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:42.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.503225 11681 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:42.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.503659 11681 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:42.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114162530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:42.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.537374 11681 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:42.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.538000 11681 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:42.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.538504 11681 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:42.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.538868 11681 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:42.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.539227 11681 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:42.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.539496 11681 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34213/jwks.json
14:22:42.542 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:22:42.543 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.576618 11681 master_runner.cc:387] Master server non-default flags:
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.189:34071
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data/info.pb
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.189
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/logs
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:42.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:42.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.577777 11681 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:42.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.579273 11681 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:42.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.588790 11690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:42.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.610658 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 4
14:22:42.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.618598 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:42.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:42.918068 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 5
14:22:42.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.925148 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:43.034 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114163030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:43.059 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=29 ms, finalizationTime=0 ms).
14:22:43.060 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:22:43.136 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:43.137 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:43.138 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:43.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.145 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:43.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:43.472597 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 6
14:22:43.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:43.513564 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.189:34071: Network error: Client connection negotiation failed: client connection to 127.11.83.189:34071: connect: Connection refused (error 111)
14:22:43.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114163530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:43.557 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
14:22:43.558 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:22:43.637 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:43.637 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:43.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.638 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:43.638 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:43.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:43.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:43.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:44.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114164031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:44.056 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:22:44.058 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:22:44.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:43.992790 11689 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 11681
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.092572 11689 kernel_stack_watchdog.cc:198] Thread 11681 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:44.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:42.590255 11691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:44.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.094117 11681 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.504s	user 0.521s	sys 0.973s
14:22:44.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.094508 11681 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.505s	user 0.521s	sys 0.973s
14:22:44.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.095511 11692 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1504 milliseconds
14:22:44.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.096261 11681 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:44.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.096313 11693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:44.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.099758 11681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.102011 11681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:44.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.103330 11681 hybrid_clock.cc:648] HybridClock initialized: now 1779114164103304 us; error 41 us; skew 500 ppm
14:22:44.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.104014 11681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:44.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.109552 11681 webserver.cc:533] Webserver started at http://127.11.83.189:36267/ using document root <none> and password file <none>
14:22:44.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.110332 11681 fs_manager.cc:362] Metadata directory not provided
14:22:44.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.110587 11681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:44.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.111043 11681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:44.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.115010 11681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data/instance:
14:22:44.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ea55d9b021e49a291356390f810305f"
14:22:44.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:44 on dist-test-slave-1n46"
14:22:44.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.115991 11681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal/instance:
14:22:44.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ea55d9b021e49a291356390f810305f"
14:22:44.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:44 on dist-test-slave-1n46"
14:22:44.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.123719 11681 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
14:22:44.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.128795 11704 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.129781 11681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.130087 11681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ea55d9b021e49a291356390f810305f"
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:44 on dist-test-slave-1n46"
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.130340 11681 fs_report.cc:389] FS layout report
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data/data
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:44.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:44.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.179108 11681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:44.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.180337 11681 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:44.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.180764 11681 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:44.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.249811 11681 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.189:34071
14:22:44.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.249895 11755 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.189:34071 every 8 connection(s)
14:22:44.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.252307 11681 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/data/info.pb
14:22:44.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.252795 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 11681
14:22:44.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.253161 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-1/wal/instance
14:22:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.255383 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal
14:22:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data
14:22:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/logs
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data/info.pb
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.188:44337
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.188
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:44.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json with env {}
14:22:44.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.258791 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:44.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.268554 11756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } has no permanent_uuid. Determining permanent_uuid...
14:22:44.276 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:44.277 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:44.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:44.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:44.278 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:44.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:44.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:44.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:44.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:44.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:44.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:44.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:44.279 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:44.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.290050 11756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
14:22:44.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.304332 11756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
14:22:44.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.306529 11707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.310688 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.360105 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 1
14:22:44.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.364405 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.432773 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 2
14:22:44.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.436790 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.528162 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 3
14:22:44.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114164530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:44.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.532476 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.541 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:22:44.543 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:22:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.562827 11758 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.563338 11758 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.563743 11758 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:44.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.574055 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } attempt: 7
14:22:44.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.585398 11679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
14:22:44.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.590819 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.597687 11758 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.597911 11758 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.598156 11758 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.598398 11758 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.598606 11758 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.598747 11758 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34213/jwks.json
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.634030 11758 master_runner.cc:387] Master server non-default flags:
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.188:44337
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34213/jwks.json
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data/info.pb
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.188
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:44.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/logs
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:44.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.635212 11758 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:44.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.636711 11758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:44.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.647238 11770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:44.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.649242 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 1
14:22:44.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.655380 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.675881 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 4
14:22:44.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.681825 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.736878 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 2
14:22:44.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.744522 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.831039 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 3
14:22:44.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.838343 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.978919 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 4
14:22:44.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:44.981408 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 5
14:22:44.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.993628 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:44.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.994580 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:45.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114165030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:45.052 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
14:22:45.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:22:45.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.278308 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 5
14:22:45.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.286208 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:45.538 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114165530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:45.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.541905 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 6
14:22:45.562 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=31 ms, finalizationTime=1 ms).
14:22:45.563 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:22:45.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.607823 11756 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:45.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.838722 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 6
14:22:45.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.864578 11679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.83.188:44337: Network error: Client connection negotiation failed: client connection to 127.11.83.188:44337: connect: Connection refused (error 111)
14:22:45.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:44.648203 11771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:45.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.958954 11772 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1308 milliseconds
14:22:45.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.959774 11773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:45.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.963510 11758 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.316s	user 0.415s	sys 0.885s
14:22:45.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:45.963776 11758 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.316s	user 0.415s	sys 0.885s
14:22:45.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.963963 11758 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:45.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.965005 11758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:45.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.968151 11758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:45.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.969810 11758 hybrid_clock.cc:648] HybridClock initialized: now 1779114165969754 us; error 67 us; skew 500 ppm
14:22:45.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.970793 11758 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:45.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.978940 11758 webserver.cc:533] Webserver started at http://127.11.83.188:36695/ using document root <none> and password file <none>
14:22:45.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.979909 11758 fs_manager.cc:362] Metadata directory not provided
14:22:45.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.980165 11758 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:45.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.980705 11758 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.985153 11758 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data/instance:
14:22:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3776988171d8467390216607f561b96c"
14:22:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:45 on dist-test-slave-1n46"
14:22:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.986395 11758 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal/instance:
14:22:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3776988171d8467390216607f561b96c"
14:22:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:45 on dist-test-slave-1n46"
14:22:45.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:45.994601 11758 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
14:22:46.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.001273 11784 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:46.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.002465 11758 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.002822 11758 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3776988171d8467390216607f561b96c"
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:45 on dist-test-slave-1n46"
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.003163 11758 fs_report.cc:389] FS layout report
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data/data
14:22:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:46.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114166030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:46.048 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:22:46.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:22:46.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.082340 11758 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:46.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.084194 11758 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:46.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.084723 11758 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:46.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.161870 11758 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.188:44337
14:22:46.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.161943 11835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.188:44337 every 8 connection(s)
14:22:46.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.165050 11758 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/data/info.pb
14:22:46.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.170759 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:46.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.171535 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 11758
14:22:46.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.172008 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/master-2/wal/instance
14:22:46.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.186388 11836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } has no permanent_uuid. Determining permanent_uuid...
14:22:46.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.220821 11836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
14:22:46.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.231197 11836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } has no permanent_uuid. Determining permanent_uuid...
14:22:46.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.249922 11836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: Bootstrap starting.
14:22:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.255988 11836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: Neither blocks nor log segments found. Creating new log.
14:22:46.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.258217 11836 log.cc:826] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: Log is configured to *not* fsync() on all Append() calls
14:22:46.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.264221 11836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: No bootstrap required, opened a new log
14:22:46.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.283736 11836 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.284322 11836 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:46.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.284516 11836 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3776988171d8467390216607f561b96c, State: Initialized, Role: FOLLOWER
14:22:46.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.285159 11836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.287336 11845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.287952 11845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: This master's current role is: FOLLOWER
14:22:46.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.289284 11836 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: configured and running, proceeding with master startup.
14:22:46.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.297391 11845 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:46.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.297753 11845 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.299793 11845 leader_election.cc:290] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39eed25e9baf450ea85c5d72a23b3dfa (127.11.83.190:41547), 1ea55d9b021e49a291356390f810305f (127.11.83.189:34071)
14:22:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:46.316175 11856 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:46.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:46.316478 11856 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:46.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.311647 11758 master_runner.cc:187] Error getting master registration for 127.11.83.190:41547: OK, instance_id { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" instance_seqno: 1779114162168831 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:46.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.339668 11758 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:46.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:46.342958 11790 tablet.cc:2404] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:46.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114166530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:46.544 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:22:46.545 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:22:46.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.668395 11756 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 7
14:22:46.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.688413 11756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: Bootstrap starting.
14:22:46.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.693866 11756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: Neither blocks nor log segments found. Creating new log.
14:22:46.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.695675 11756 log.cc:826] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: Log is configured to *not* fsync() on all Append() calls
14:22:46.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.701633 11756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: No bootstrap required, opened a new log
14:22:46.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.727468 11756 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.728420 11756 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:46.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.728870 11756 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ea55d9b021e49a291356390f810305f, State: Initialized, Role: FOLLOWER
14:22:46.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.729992 11756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.733351 11860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.734360 11860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: This master's current role is: FOLLOWER
14:22:46.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.734877 11756 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: configured and running, proceeding with master startup.
14:22:46.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.736999 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3776988171d8467390216607f561b96c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ea55d9b021e49a291356390f810305f" is_pre_election: true
14:22:46.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.737785 11731 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3776988171d8467390216607f561b96c in term 0.
14:22:46.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.739300 11788 leader_election.cc:304] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ea55d9b021e49a291356390f810305f, 3776988171d8467390216607f561b96c; no voters: 
14:22:46.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.740374 11845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:46.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.740713 11845 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:46.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.741101 11845 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 0 FOLLOWER]: Advancing to term 1
14:22:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.748636 11845 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.752200 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3776988171d8467390216607f561b96c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ea55d9b021e49a291356390f810305f"
14:22:46.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.752866 11731 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 0 FOLLOWER]: Advancing to term 1
14:22:46.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.762367 11845 leader_election.cc:290] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [CANDIDATE]: Term 1 election: Requested vote from peers 39eed25e9baf450ea85c5d72a23b3dfa (127.11.83.190:41547), 1ea55d9b021e49a291356390f810305f (127.11.83.189:34071)
14:22:46.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.761704 11731 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3776988171d8467390216607f561b96c in term 1.
14:22:46.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.765563 11788 leader_election.cc:304] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ea55d9b021e49a291356390f810305f, 3776988171d8467390216607f561b96c; no voters: 
14:22:46.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.766870 11845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 1 FOLLOWER]: Leader election won for term 1
14:22:46.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.770192 11845 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [term 1 LEADER]: Becoming Leader. State: Replica: 3776988171d8467390216607f561b96c, State: Running, Role: LEADER
14:22:46.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.771267 11845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.780472 11869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3776988171d8467390216607f561b96c. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.781550 11869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: This master's current role is: LEADER
14:22:46.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.790109 11872 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:22:46.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.798900 11872 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:22:46.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.804371 11874 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:22:46.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.821692 11731 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [term 1 FOLLOWER]: Refusing update from remote peer 3776988171d8467390216607f561b96c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:46.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.823418 11869 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:46.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.809259 11681 master_runner.cc:187] Error getting master registration for 127.11.83.190:41547: OK, instance_id { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" instance_seqno: 1779114162168831 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:46.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.846894 11681 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:46.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.853513 11860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3776988171d8467390216607f561b96c. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.854579 11860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: This master's current role is: FOLLOWER
14:22:46.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.856081 11875 mvcc.cc:204] Tried to move back new op lower bound from 7287251627288125440 to 7287251627103719424. Current Snapshot: MvccSnapshot[applied={T|T < 7287251627288125440}]
14:22:46.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.859544 11860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.860330 11860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f [sys.catalog]: This master's current role is: FOLLOWER
14:22:46.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.866811 11845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.867547 11845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: This master's current role is: LEADER
14:22:46.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.869310 11872 catalog_manager.cc:1383] Generated new cluster ID: 315194d6b18f47e79fab49a705597361
14:22:46.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.869573 11872 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:22:46.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.897230 11872 catalog_manager.cc:1406] Generated new certificate authority record
14:22:46.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.898000 11679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } attempt: 7
14:22:46.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.903677 11872 catalog_manager.cc:1540] Loading token signing keys...
14:22:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.918799 11679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: Bootstrap starting.
14:22:46.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.925987 11679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: Neither blocks nor log segments found. Creating new log.
14:22:46.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.928203 11679 log.cc:826] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: Log is configured to *not* fsync() on all Append() calls
14:22:46.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.932512 11679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: No bootstrap required, opened a new log
14:22:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.936898 11872 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c: Generated new TSK 0
14:22:46.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.937940 11872 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:22:46.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.958231 11679 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.958894 11679 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:46.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.959299 11679 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39eed25e9baf450ea85c5d72a23b3dfa, State: Initialized, Role: FOLLOWER
14:22:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.960047 11679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.962306 11883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:46.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.963156 11883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: This master's current role is: FOLLOWER
14:22:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.964016 11679 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: configured and running, proceeding with master startup.
14:22:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.964246 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3776988171d8467390216607f561b96c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" is_pre_election: true
14:22:46.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.964875 11652 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 0 FOLLOWER]: Advancing to term 1
14:22:46.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.964246 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3776988171d8467390216607f561b96c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39eed25e9baf450ea85c5d72a23b3dfa"
14:22:46.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.972606 11652 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 1 FOLLOWER]: Refusing update from remote peer 3776988171d8467390216607f561b96c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:46.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.974282 11883 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:46.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.974282 11869 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [LEADER]: Connected to new peer: Peer: permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:46.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.974927 11883 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } }
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.978181 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/logs
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data/info.pb
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.129:0
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.129
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.129
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:46.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.985598 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ea55d9b021e49a291356390f810305f" is_pre_election: true
14:22:46.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.988914 11883 leader_election.cc:290] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ea55d9b021e49a291356390f810305f (127.11.83.189:34071), 3776988171d8467390216607f561b96c (127.11.83.188:44337)
14:22:46.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.989580 11811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3776988171d8467390216607f561b96c" is_pre_election: true
14:22:46.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:46.993543 11630 leader_election.cc:304] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39eed25e9baf450ea85c5d72a23b3dfa; no voters: 1ea55d9b021e49a291356390f810305f, 3776988171d8467390216607f561b96c
14:22:47.034 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114167031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:47.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.044458 11886 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:22:47.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.047410 11883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3776988171d8467390216607f561b96c. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:47.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.048069 11883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: This master's current role is: FOLLOWER
14:22:47.051 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
14:22:47.052 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:22:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.051578 11893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:47.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.054528 11893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa [sys.catalog]: This master's current role is: FOLLOWER
14:22:47.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.082958 11902 catalog_manager.cc:1295] Loaded cluster ID: 315194d6b18f47e79fab49a705597361
14:22:47.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.083580 11902 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: loading cluster ID for follower catalog manager: success
14:22:47.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.090826 11902 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: acquiring CA information for follower catalog manager: success
14:22:47.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.098094 11902 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 39eed25e9baf450ea85c5d72a23b3dfa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:47.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.501446 11888 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:47.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.502089 11888 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:47.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.502806 11888 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:47.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114167531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:47.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.543889 11908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3776988171d8467390216607f561b96c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39eed25e9baf450ea85c5d72a23b3dfa" member_type: VOTER last_known_addr { host: "127.11.83.190" port: 41547 } } peers { permanent_uuid: "1ea55d9b021e49a291356390f810305f" member_type: VOTER last_known_addr { host: "127.11.83.189" port: 34071 } } peers { permanent_uuid: "3776988171d8467390216607f561b96c" member_type: VOTER last_known_addr { host: "127.11.83.188" port: 44337 } } }
14:22:47.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.544783 11908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3776988171d8467390216607f561b96c [sys.catalog]: This master's current role is: LEADER
14:22:47.551 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
14:22:47.552 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:22:47.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.559031 11888 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:47.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.559851 11888 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.83.129
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.596155 11888 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.129:0
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data/info.pb
14:22:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.129
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.129
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/logs
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:47.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:47.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.598376 11888 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:47.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.600360 11888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:47.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.613332 11912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.833079 11874 catalog_manager.cc:1295] Loaded cluster ID: 315194d6b18f47e79fab49a705597361
14:22:47.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.835628 11874 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: loading cluster ID for follower catalog manager: success
14:22:47.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.864550 11874 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: acquiring CA information for follower catalog manager: success
14:22:47.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:47.887480 11874 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1ea55d9b021e49a291356390f810305f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:47.956 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:47.957 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:47.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:47.958 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:47.958 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:47.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:47.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:47.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:47.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:47.959 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:47.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:47.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:47.959 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:48.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114168030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:48.050 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
14:22:48.052 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:22:48.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114168530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:48.592 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=61 ms, finalizationTime=1 ms).
14:22:48.594 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:22:49.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114169030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:49.045 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:22:49.047 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:22:49.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114169530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:49.557 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
14:22:49.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:49.019407 11911 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 11888
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.006713 11911 kernel_stack_watchdog.cc:198] Thread 11888 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:47.614744 11913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:50.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.011718 11914 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2392 milliseconds
14:22:50.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.015877 11888 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.400s	user 0.002s	sys 0.004s
14:22:50.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.016392 11888 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.400s	user 0.003s	sys 0.004s
14:22:50.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.017776 11888 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:50.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.018368 11916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.019917 11888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:50.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.026628 11888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:50.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.028160 11888 hybrid_clock.cc:648] HybridClock initialized: now 1779114170028116 us; error 36 us; skew 500 ppm
14:22:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.029237 11888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:50.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114170031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:50.046 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:22:50.048 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:22:50.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.056550 11888 webserver.cc:533] Webserver started at http://127.11.83.129:46757/ using document root <none> and password file <none>
14:22:50.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.057917 11888 fs_manager.cc:362] Metadata directory not provided
14:22:50.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.058372 11888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:50.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.059024 11888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:50.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.066406 11888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data/instance:
14:22:50.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:22:50.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:50 on dist-test-slave-1n46"
14:22:50.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.068087 11888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal/instance:
14:22:50.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:22:50.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:50 on dist-test-slave-1n46"
14:22:50.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.083385 11888 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.005s	sys 0.008s
14:22:50.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.097777 11925 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:50.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.099426 11888 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.002s	sys 0.007s
14:22:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.099958 11888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal
14:22:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:22:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:50 on dist-test-slave-1n46"
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.100600 11888 fs_report.cc:389] FS layout report
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data/data
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.237347 11888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.239730 11888 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.240463 11888 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:50.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.252220 11888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:50.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.272775 11888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:50.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.273231 11888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
14:22:50.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.273618 11888 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:50.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.273926 11888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:50.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114170531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.534147 11888 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.129:32843
14:22:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.534319 12038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.129:32843 every 8 connection(s)
14:22:50.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.540328 11888 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/data/info.pb
14:22:50.543 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:22:50.544 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:22:50.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.547178 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 11888
14:22:50.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.547923 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-0/wal/instance
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.564064 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/logs
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data/info.pb
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:50.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.130:0
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.130
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.130
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:50.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.590837 12039 heartbeater.cc:344] Connected to a master server at 127.11.83.188:44337
14:22:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.591329 12039 heartbeater.cc:461] Registering TS with master...
14:22:50.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.592824 12039 heartbeater.cc:507] Master 127.11.83.188:44337 requested a full tablet report, sending...
14:22:50.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.596101 11801 ts_manager.cc:194] Registered new tserver with Master: bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843)
14:22:50.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.598814 11801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.83.129:60931
14:22:50.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.620671 12040 heartbeater.cc:344] Connected to a master server at 127.11.83.189:34071
14:22:50.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.620990 12040 heartbeater.cc:461] Registering TS with master...
14:22:50.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.621608 12040 heartbeater.cc:507] Master 127.11.83.189:34071 requested a full tablet report, sending...
14:22:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.624965 11721 ts_manager.cc:194] Registered new tserver with Master: bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843)
14:22:50.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.646899 12045 heartbeater.cc:344] Connected to a master server at 127.11.83.190:41547
14:22:50.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.647285 12045 heartbeater.cc:461] Registering TS with master...
14:22:50.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.647895 12045 heartbeater.cc:507] Master 127.11.83.190:41547 requested a full tablet report, sending...
14:22:50.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.650816 11644 ts_manager.cc:194] Registered new tserver with Master: bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843)
14:22:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.915488 12043 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.915932 12043 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.916364 12043 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:50.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.948262 12043 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:50.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:50.949026 12043 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.83.130
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.985926 12043 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.130:0
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data/info.pb
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.130
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.130
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/logs
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.987213 12043 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:50.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:50.988691 12043 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:51.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:51.002040 12054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:51.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114171030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:51.043 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:22:51.045 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:22:51.534 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114171530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:51.553 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
14:22:51.556 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:22:51.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:51.603919 12039 heartbeater.cc:499] Master 127.11.83.188:44337 was elected leader, sending a full tablet report...
14:22:52.016 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:52.017 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:52.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:52.018 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:52.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:52.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:52.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:52.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:52.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:52.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:52.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:52.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:52.020 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:52.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114172030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:52.043 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:22:52.045 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:22:52.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:51.004911 12055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:52.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:51.005822 12057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:52.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:52.449458 12056 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1444 milliseconds
14:22:52.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.449561 12043 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:52.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.450711 12043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:52.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.452853 12043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:52.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.454159 12043 hybrid_clock.cc:648] HybridClock initialized: now 1779114172454129 us; error 49 us; skew 500 ppm
14:22:52.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.454943 12043 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.461077 12043 webserver.cc:533] Webserver started at http://127.11.83.130:38595/ using document root <none> and password file <none>
14:22:52.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.462029 12043 fs_manager.cc:362] Metadata directory not provided
14:22:52.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.462219 12043 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:52.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.462666 12043 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:52.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.467518 12043 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data/instance:
14:22:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:22:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:52 on dist-test-slave-1n46"
14:22:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.468665 12043 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal/instance:
14:22:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:22:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:52 on dist-test-slave-1n46"
14:22:52.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.475637 12043 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
14:22:52.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.481583 12069 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:52.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.482707 12043 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.482965 12043 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:52 on dist-test-slave-1n46"
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.483232 12043 fs_report.cc:389] FS layout report
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data/data
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:52.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:52.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.527460 12043 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:52.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.528923 12043 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:52.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.529304 12043 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:52.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114172530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:52.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.532290 12043 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.539961 12043 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.540257 12043 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.540575 12043 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.540781 12043 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:52.541 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:22:52.546 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:22:52.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.683970 12043 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.130:43593
14:22:52.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.684053 12181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.130:43593 every 8 connection(s)
14:22:52.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.686750 12043 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/data/info.pb
14:22:52.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.692216 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12043
14:22:52.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.692798 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-1/wal/instance
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.720638 11598 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/logs
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data/info.pb
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.131:0
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.131
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.131
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:52.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.732985 12184 heartbeater.cc:344] Connected to a master server at 127.11.83.190:41547
14:22:52.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.733456 12184 heartbeater.cc:461] Registering TS with master...
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.734270 12182 heartbeater.cc:344] Connected to a master server at 127.11.83.188:44337
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.734567 12183 heartbeater.cc:344] Connected to a master server at 127.11.83.189:34071
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.734622 12182 heartbeater.cc:461] Registering TS with master...
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.734783 12184 heartbeater.cc:507] Master 127.11.83.190:41547 requested a full tablet report, sending...
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.734964 12183 heartbeater.cc:461] Registering TS with master...
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.735630 12182 heartbeater.cc:507] Master 127.11.83.188:44337 requested a full tablet report, sending...
14:22:52.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.735877 12183 heartbeater.cc:507] Master 127.11.83.189:34071 requested a full tablet report, sending...
14:22:52.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.738051 11801 ts_manager.cc:194] Registered new tserver with Master: 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:22:52.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.738669 11644 ts_manager.cc:194] Registered new tserver with Master: 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:22:52.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.739533 11801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.83.130:41569
14:22:52.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:52.740702 11721 ts_manager.cc:194] Registered new tserver with Master: 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:22:53.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.016287 12192 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.016772 12192 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.017307 12192 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:53.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114173031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:53.040 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:22:53.041 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:22:53.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.052066 12192 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:53.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.053115 12192 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.83.131
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:53.089136 12192 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.83.148:35481
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.83.131:0
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data/info.pb
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.83.131
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.83.190:41547,127.11.83.189:34071,127.11.83.188:44337
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.83.131
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/logs
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:53.090672 12192 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:53.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:53.092232 12192 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:53.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.104435 12198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:53.157 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:53.157 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:53.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:53.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:53.159 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:53.160 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:53.161 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:53.161 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:53.161 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:53.162 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:53.162 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:53.162 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:53.162 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:53.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114173531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:53.551 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
14:22:53.560 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:22:53.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:53.743270 12182 heartbeater.cc:499] Master 127.11.83.188:44337 was elected leader, sending a full tablet report...
14:22:54.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114174030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:54.055 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:22:54.057 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:22:54.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114174530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:54.547 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:22:54.548 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:22:54.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:54.506136 12197 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 12192
14:22:54.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:53.104887 12199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:54.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:54.752801 12192 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.648s	user 0.539s	sys 1.058s
14:22:54.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:54.755194 12201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:54.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:54.755955 12192 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.651s	user 0.539s	sys 1.058s
14:22:54.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:54.759384 12200 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1649 milliseconds
14:22:54.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.759388 12192 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:54.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.760712 12192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:54.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.762960 12192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:54.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.764362 12192 hybrid_clock.cc:648] HybridClock initialized: now 1779114174764253 us; error 109 us; skew 500 ppm
14:22:54.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.765184 12192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:54.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.771062 12192 webserver.cc:533] Webserver started at http://127.11.83.131:44033/ using document root <none> and password file <none>
14:22:54.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.772204 12192 fs_manager.cc:362] Metadata directory not provided
14:22:54.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.772399 12192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:54.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.772761 12192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:54.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.776968 12192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data/instance:
14:22:54.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:22:54.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:54 on dist-test-slave-1n46"
14:22:54.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.778059 12192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal/instance:
14:22:54.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:22:54.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:54 on dist-test-slave-1n46"
14:22:54.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.784802 12192 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
14:22:54.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.789827 12209 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.790869 12192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.791182 12192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:54 on dist-test-slave-1n46"
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.791455 12192 fs_report.cc:389] FS layout report
14:22:54.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data/data
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:54.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:54.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.837630 12192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:54.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.839074 12192 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:54.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.839447 12192 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:54.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.841833 12192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.845678 12192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.845918 12192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.846295 12192 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.846467 12192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:54.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.980497 12192 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.131:33751
14:22:54.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.980599 12321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.131:33751 every 8 connection(s)
14:22:54.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.983116 12192 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/data/info.pb
14:22:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.989092 11598 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12192
14:22:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:54.989585 11598 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster5039533491568421746/ts-2/wal/instance
14:22:55.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.028250 12323 heartbeater.cc:344] Connected to a master server at 127.11.83.189:34071
14:22:55.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.028764 12323 heartbeater.cc:461] Registering TS with master...
14:22:55.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.029245 12322 heartbeater.cc:344] Connected to a master server at 127.11.83.188:44337
14:22:55.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.029534 12322 heartbeater.cc:461] Registering TS with master...
14:22:55.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.029872 12323 heartbeater.cc:507] Master 127.11.83.189:34071 requested a full tablet report, sending...
14:22:55.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.030447 12324 heartbeater.cc:344] Connected to a master server at 127.11.83.190:41547
14:22:55.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.030577 12322 heartbeater.cc:507] Master 127.11.83.188:44337 requested a full tablet report, sending...
14:22:55.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.030761 12324 heartbeater.cc:461] Registering TS with master...
14:22:55.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.031491 12324 heartbeater.cc:507] Master 127.11.83.190:41547 requested a full tablet report, sending...
14:22:55.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114175030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:55.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.032629 11721 ts_manager.cc:194] Registered new tserver with Master: 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:22:55.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.035449 11644 ts_manager.cc:194] Registered new tserver with Master: 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:22:55.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.040660 11801 ts_manager.cc:194] Registered new tserver with Master: 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:22:55.043 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:22:55.043 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:22:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.042701 11801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.83.131:32867
14:22:55.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.047536 11598 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:22:55.059 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:55.059 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:22:55.060 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.83.190"
      port: 41547
    }
    bound_http_address {
      host: "127.11.83.190"
      port: 40139
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.83.189"
      port: 34071
    }
    bound_http_address {
      host: "127.11.83.189"
      port: 36267
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.83.188"
      port: 44337
    }
    bound_http_address {
      host: "127.11.83.188"
      port: 36695
    }
  }
}

14:22:55.060 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:22:55.063 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.83.129"
      port: 32843
    }
    bound_http_address {
      host: "127.11.83.129"
      port: 46757
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.83.130"
      port: 43593
    }
    bound_http_address {
      host: "127.11.83.130"
      port: 38595
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.83.131"
      port: 33751
    }
    bound_http_address {
      host: "127.11.83.131"
      port: 44033
    }
  }
}

14:22:55.063 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:22:55.065 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:55.065 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:22:55.066 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:22:55.066 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:22:55.066 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:22:55.068 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:22:55.399 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:55.400 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:22:55.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.402649 12332 mini_oidc.cc:150] Starting JWKS server
14:22:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.405594 12332 webserver.cc:533] Webserver started at http://127.0.0.1:38175/ using document root <none> and password file <none>
14:22:55.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.405933 12332 mini_oidc.cc:186] Starting OIDC Discovery server
14:22:55.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.407378 12332 webserver.cc:533] Webserver started at http://127.0.0.1:36831/ using document root <none> and password file <none>
14:22:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:22:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:55Z Disabled control of system clock
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.462392 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/logs
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data/info.pb
14:22:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.62:39875
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.62
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json with env {}
14:22:55.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114175530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:55.544 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:22:55.546 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:22:55.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.770373 12344 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:55.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.770892 12344 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:55.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.771323 12344 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.802479 12344 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.802788 12344 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.803001 12344 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.803215 12344 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.803399 12344 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.803543 12344 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38175/jwks.json
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.836796 12344 master_runner.cc:387] Master server non-default flags:
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.62:39875
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data/info.pb
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.62
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/logs
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:55.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.838040 12344 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:55.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:55.839555 12344 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:55.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.848546 12350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:56.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114176030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:56.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:56.051380 12322 heartbeater.cc:499] Master 127.11.83.188:44337 was elected leader, sending a full tablet report...
14:22:56.077 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=45 ms, finalizationTime=1 ms).
14:22:56.079 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:22:56.532 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114176531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:56.555 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
14:22:56.556 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:56.556 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:22:56.557 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:56.558 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:56.558 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:56.558 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:56.558 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:56.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:56.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:56.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:56.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:56.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:56.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:56.560 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:57.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114177030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:57.057 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
14:22:57.060 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:22:57.136 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:57.137 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:57.137 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:57.138 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:57.138 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:57.138 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:57.139 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:57.139 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:57.139 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:57.140 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:57.140 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:57.140 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:57.140 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:57.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.252795 12349 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 12344
14:22:57.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.520028 12349 kernel_stack_watchdog.cc:198] Thread 12344 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:22:57.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:57.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:57.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:57.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:57.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.520457 12344 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.671s	user 0.496s	sys 1.082s
14:22:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:55.850217 12351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.524324 12344 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.675s	user 0.496s	sys 1.085s
14:22:57.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.526067 12353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.528725 12352 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1675 milliseconds
14:22:57.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.528789 12344 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.529857 12344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:57.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114177530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:57.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.544847 12344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:57.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.546360 12344 hybrid_clock.cc:648] HybridClock initialized: now 1779114177546312 us; error 35 us; skew 500 ppm
14:22:57.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.547479 12344 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:57.550 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
14:22:57.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:22:57.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.554381 12344 webserver.cc:533] Webserver started at http://127.12.11.62:45881/ using document root <none> and password file <none>
14:22:57.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.555303 12344 fs_manager.cc:362] Metadata directory not provided
14:22:57.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.555536 12344 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:57.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.556033 12344 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:57.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.560251 12344 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data/instance:
14:22:57.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9da71930aa874518b497ef6a68a4bdb8"
14:22:57.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:57 on dist-test-slave-1n46"
14:22:57.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.561408 12344 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal/instance:
14:22:57.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9da71930aa874518b497ef6a68a4bdb8"
14:22:57.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:57 on dist-test-slave-1n46"
14:22:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.568248 12344 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.001s
14:22:57.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.573530 12361 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.574492 12344 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.574839 12344 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9da71930aa874518b497ef6a68a4bdb8"
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:57 on dist-test-slave-1n46"
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.575167 12344 fs_report.cc:389] FS layout report
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data/data
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:57.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.623539 12344 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:57.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.624953 12344 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:57.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.625377 12344 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:57.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.698866 12344 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.62:39875
14:22:57.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.699038 12412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.62:39875 every 8 connection(s)
14:22:57.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.701403 12344 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/data/info.pb
14:22:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.704058 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12344
14:22:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.704537 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-0/wal/instance
14:22:57.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.708359 12413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.709367 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/logs
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data/info.pb
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:57.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.61:45967
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.61
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:57.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json with env {}
14:22:57.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.721076 12413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } has no permanent_uuid. Determining permanent_uuid...
14:22:57.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.746001 12413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } has no permanent_uuid. Determining permanent_uuid...
14:22:57.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.748323 12365 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:57.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.752288 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.801697 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 1
14:22:57.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.805797 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:57.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.874186 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 2
14:22:57.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.878125 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:57.969483 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 3
14:22:57.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:57.973696 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:58.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.017026 12415 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:58.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.017483 12415 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:58.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.017856 12415 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:58.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114178030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:58.039 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:22:58.042 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:22:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.056022 12415 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.056282 12415 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.056480 12415 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.056668 12415 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.056866 12415 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:58.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.057008 12415 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38175/jwks.json
14:22:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.095458 12415 master_runner.cc:387] Master server non-default flags:
14:22:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.61:45967
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data/info.pb
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.61
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/logs
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:58.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:58.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.096845 12415 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:58.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.098930 12415 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.111841 12424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:58.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.117082 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 4
14:22:58.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.122220 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:58.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.421785 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 5
14:22:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.428836 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:58.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114178530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:58.548 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:22:58.550 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:22:58.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:58.976361 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 6
14:22:59.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.008744 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.61:45967: Network error: Client connection negotiation failed: client connection to 127.12.11.61:45967: connect: Connection refused (error 111)
14:22:59.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114179030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:59.036 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:22:59.037 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:22:59.038 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:22:59.038 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:59.039 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:59.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:22:59.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:59.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:59.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:22:59.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:59.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:59.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:22:59.042 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:22:59.050 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
14:22:59.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:22:59.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:58.114480 12425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.356886 12427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.360108 12426 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1244 milliseconds
14:22:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.360183 12415 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.361385 12415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:59.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.363965 12415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:59.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.365320 12415 hybrid_clock.cc:648] HybridClock initialized: now 1779114179365291 us; error 33 us; skew 500 ppm
14:22:59.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.366267 12415 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:59.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.371978 12415 webserver.cc:533] Webserver started at http://127.12.11.61:36989/ using document root <none> and password file <none>
14:22:59.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.372885 12415 fs_manager.cc:362] Metadata directory not provided
14:22:59.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.373122 12415 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:59.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.373624 12415 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.377871 12415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data/instance:
14:22:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c8c4c438782641df9e03e3cff14e134f"
14:22:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:59 on dist-test-slave-1n46"
14:22:59.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.379138 12415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal/instance:
14:22:59.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c8c4c438782641df9e03e3cff14e134f"
14:22:59.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:59 on dist-test-slave-1n46"
14:22:59.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.385674 12415 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
14:22:59.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.390960 12437 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:59.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.391849 12415 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
14:22:59.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.392165 12415 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal
14:22:59.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c8c4c438782641df9e03e3cff14e134f"
14:22:59.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:59 on dist-test-slave-1n46"
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.392499 12415 fs_report.cc:389] FS layout report
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data/data
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:59.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.449465 12415 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:59.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.450836 12415 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:59.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.451328 12415 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:59.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.523088 12415 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.61:45967
14:22:59.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.523191 12488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.61:45967 every 8 connection(s)
14:22:59.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.525838 12415 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/data/info.pb
14:22:59.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.528578 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12415
14:22:59.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.529043 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-1/wal/instance
14:22:59.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114179530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.531869 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/logs
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data/info.pb
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.60:37961
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.60
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json with env {}
14:22:59.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.533712 12489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:59.544 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:22:59.547 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:22:59.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.549352 12489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } has no permanent_uuid. Determining permanent_uuid...
14:22:59.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.585892 12489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } has no permanent_uuid. Determining permanent_uuid...
14:22:59.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.600203 12489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } has no permanent_uuid. Determining permanent_uuid...
14:22:59.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.602347 12440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:22:59.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.606032 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:22:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.655447 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 1
14:22:59.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.658885 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:22:59.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.727205 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 2
14:22:59.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.730705 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:22:59.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.822070 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 3
14:22:59.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.826604 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:22:59.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.855780 12491 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:59.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.856426 12491 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:59.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.856950 12491 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:59.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.889446 12491 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:59.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.889765 12491 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:59.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.890126 12491 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:59.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.890583 12491 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:59.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.890875 12491 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:59.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.891115 12491 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38175/jwks.json
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.926429 12491 master_runner.cc:387] Master server non-default flags:
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal
14:22:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.60:37961
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38175/jwks.json
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data/info.pb
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.60
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/logs
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.927928 12491 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:59.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.929402 12491 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:59.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.939611 12502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:59.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:59.970080 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 4
14:22:59.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.975126 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.032 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114180031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:00.054 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
14:23:00.056 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:23:00.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.069325 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } attempt: 7
14:23:00.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.126278 12413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } has no permanent_uuid. Determining permanent_uuid...
14:23:00.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.139055 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.197486 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 1
14:23:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.204093 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.236 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:00.237 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:00.238 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:00.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:00.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:00.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:00.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:00.239 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:00.239 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:00.240 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:00.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:00.240 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:00.241 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:00.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.274679 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 5
14:23:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.284018 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.285602 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 2
14:23:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.292176 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.377717 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 3
14:23:00.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.384575 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.525048 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 4
14:23:00.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.531603 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.533 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114180531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:00.551 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
14:23:00.553 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:23:00.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.815038 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 5
14:23:00.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.822523 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:00.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:00.831528 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 6
14:23:00.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:00.860538 12489 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:01.033 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114181031 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:01.048 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:23:01.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:23:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.375010 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 6
14:23:01.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.403640 12413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.11.60:37961: Network error: Client connection negotiation failed: client connection to 127.12.11.60:37961: connect: Connection refused (error 111)
14:23:01.530 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114181530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:01.543 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:23:01.544 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:23:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.343168 12501 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 12491
14:23:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:59.940477 12503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.710147 12491 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.770s	user 0.570s	sys 1.153s
14:23:01.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.711812 12491 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.772s	user 0.570s	sys 1.153s
14:23:01.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.712467 12505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:01.716611 12504 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1770 milliseconds
14:23:01.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.716634 12491 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.717790 12491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:01.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.720045 12491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:01.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.721390 12491 hybrid_clock.cc:648] HybridClock initialized: now 1779114181721349 us; error 32 us; skew 500 ppm
14:23:01.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.722234 12491 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:01.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.728391 12491 webserver.cc:533] Webserver started at http://127.12.11.60:42395/ using document root <none> and password file <none>
14:23:01.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.729287 12491 fs_manager.cc:362] Metadata directory not provided
14:23:01.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.729549 12491 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:01.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.730068 12491 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.734252 12491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data/instance:
14:23:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24d5afb6198f42eab8e57771a6fd824a"
14:23:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:01 on dist-test-slave-1n46"
14:23:01.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.735450 12491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal/instance:
14:23:01.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24d5afb6198f42eab8e57771a6fd824a"
14:23:01.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:01 on dist-test-slave-1n46"
14:23:01.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.742652 12491 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.002s
14:23:01.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.748258 12520 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.749258 12491 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
14:23:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.749619 12491 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24d5afb6198f42eab8e57771a6fd824a"
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:01 on dist-test-slave-1n46"
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.749944 12491 fs_report.cc:389] FS layout report
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data/data
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:01.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.807367 12491 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:01.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.808881 12491 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:01.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.809365 12491 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:01.876 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [6ms] received response from server master-127.9.135.188:36123: OK, deferred=null) with no deferred attached!
14:23:01.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.881649 12491 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.60:37961
14:23:01.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.881780 12571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.60:37961 every 8 connection(s)
14:23:01.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.884171 12491 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/data/info.pb
14:23:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.889117 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12491
14:23:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.889601 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/master-2/wal/instance
14:23:01.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.890033 12572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:01.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.904745 12572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } has no permanent_uuid. Determining permanent_uuid...
14:23:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.920992 12489 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 7
14:23:01.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.929478 12572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } has no permanent_uuid. Determining permanent_uuid...
14:23:01.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.941329 12572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } has no permanent_uuid. Determining permanent_uuid...
14:23:01.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.955559 12489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: Bootstrap starting.
14:23:01.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.960312 12489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: Neither blocks nor log segments found. Creating new log.
14:23:01.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.960800 12572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: Bootstrap starting.
14:23:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.963338 12489 log.cc:826] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: Log is configured to *not* fsync() on all Append() calls
14:23:01.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.968158 12489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: No bootstrap required, opened a new log
14:23:01.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.970243 12572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: Neither blocks nor log segments found. Creating new log.
14:23:01.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.971750 12572 log.cc:826] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: Log is configured to *not* fsync() on all Append() calls
14:23:01.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.976033 12572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: No bootstrap required, opened a new log
14:23:01.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.989099 12489 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:01.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.989691 12489 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:01.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.989969 12489 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c4c438782641df9e03e3cff14e134f, State: Initialized, Role: FOLLOWER
14:23:01.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.990973 12489 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:01.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.994423 12584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:01.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.995234 12584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: This master's current role is: FOLLOWER
14:23:01.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:01.996307 12489 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: configured and running, proceeding with master startup.
14:23:02.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.000159 12572 raft_consensus.cc:359] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.000663 12572 raft_consensus.cc:385] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:02.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.000880 12572 raft_consensus.cc:740] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d5afb6198f42eab8e57771a6fd824a, State: Initialized, Role: FOLLOWER
14:23:02.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.001938 12572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.006254 12588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.008085 12572 sys_catalog.cc:565] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: configured and running, proceeding with master startup.
14:23:02.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.008404 12588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114182030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.048555 12607 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:23:02.049 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
14:23:02.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:23:02.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.064563 12526 tablet.cc:2404] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:02.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.066629 12606 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:23:02.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.066951 12606 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:23:02.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.039031 12491 master_runner.cc:187] Error getting master registration for 127.12.11.62:39875: OK, instance_id { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" instance_seqno: 1779114177677507 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:02.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.081449 12491 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:02.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.053659 12415 master_runner.cc:187] Error getting master registration for 127.12.11.62:39875: OK, instance_id { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" instance_seqno: 1779114177677507 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:02.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.091574 12415 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:02.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.208803 12443 tablet.cc:2404] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:02.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.213442 12584 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:02.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.213924 12584 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.216084 12584 leader_election.cc:290] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da71930aa874518b497ef6a68a4bdb8 (127.12.11.62:39875), 24d5afb6198f42eab8e57771a6fd824a (127.12.11.60:37961)
14:23:02.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.217682 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c4c438782641df9e03e3cff14e134f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d5afb6198f42eab8e57771a6fd824a" is_pre_election: true
14:23:02.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.218446 12547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c4c438782641df9e03e3cff14e134f in term 0.
14:23:02.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.219380 12440 leader_election.cc:304] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d5afb6198f42eab8e57771a6fd824a, c8c4c438782641df9e03e3cff14e134f; no voters: 
14:23:02.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.220147 12584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:02.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.220460 12584 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:02.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.220747 12584 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 0 FOLLOWER]: Advancing to term 1
14:23:02.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.226851 12584 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.228497 12584 leader_election.cc:290] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [CANDIDATE]: Term 1 election: Requested vote from peers 9da71930aa874518b497ef6a68a4bdb8 (127.12.11.62:39875), 24d5afb6198f42eab8e57771a6fd824a (127.12.11.60:37961)
14:23:02.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.229542 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c4c438782641df9e03e3cff14e134f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d5afb6198f42eab8e57771a6fd824a"
14:23:02.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.230074 12547 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 0 FOLLOWER]: Advancing to term 1
14:23:02.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.236850 12547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c4c438782641df9e03e3cff14e134f in term 1.
14:23:02.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.242369 12440 leader_election.cc:304] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d5afb6198f42eab8e57771a6fd824a, c8c4c438782641df9e03e3cff14e134f; no voters: 
14:23:02.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.243098 12584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 1 FOLLOWER]: Leader election won for term 1
14:23:02.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.245245 12584 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [term 1 LEADER]: Becoming Leader. State: Replica: c8c4c438782641df9e03e3cff14e134f, State: Running, Role: LEADER
14:23:02.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.246162 12584 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.252707 12609 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8c4c438782641df9e03e3cff14e134f. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.253480 12609 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: This master's current role is: LEADER
14:23:02.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.256984 12611 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:23:02.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.279989 12611 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:23:02.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.309350 12547 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [term 1 FOLLOWER]: Refusing update from remote peer c8c4c438782641df9e03e3cff14e134f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:02.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.311523 12609 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:02.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.331135 12588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8c4c438782641df9e03e3cff14e134f. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.331848 12588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.344110 12613 mvcc.cc:204] Tried to move back new op lower bound from 7287251690719428608 to 7287251690487791616. Current Snapshot: MvccSnapshot[applied={T|T < 7287251690719428608}]
14:23:02.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.351886 12584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.352584 12584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: This master's current role is: LEADER
14:23:02.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.354944 12611 catalog_manager.cc:1383] Generated new cluster ID: 3ce6fec2f0ba47f9a955368f0eeb03ec
14:23:02.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.355214 12611 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:23:02.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.359686 12588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.360301 12588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.388800 12611 catalog_manager.cc:1406] Generated new certificate authority record
14:23:02.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.390949 12611 catalog_manager.cc:1540] Loading token signing keys...
14:23:02.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.425320 12611 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f: Generated new TSK 0
14:23:02.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.426630 12611 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:23:02.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.437058 12413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } attempt: 7
14:23:02.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.463775 12413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: Bootstrap starting.
14:23:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.471693 12413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: Neither blocks nor log segments found. Creating new log.
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.471756 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/logs
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data/info.pb
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.1:0
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.1
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.1
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.473935 12413 log.cc:826] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: Log is configured to *not* fsync() on all Append() calls
14:23:02.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.484736 12413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: No bootstrap required, opened a new log
14:23:02.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.513216 12413 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114182530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:02.544 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:23:02.545 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:23:02.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.563395 12413 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:02.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.565817 12413 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da71930aa874518b497ef6a68a4bdb8, State: Initialized, Role: FOLLOWER
14:23:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.566983 12413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } }
14:23:02.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.587337 12387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c4c438782641df9e03e3cff14e134f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da71930aa874518b497ef6a68a4bdb8"
14:23:02.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.588233 12388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8c4c438782641df9e03e3cff14e134f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da71930aa874518b497ef6a68a4bdb8" is_pre_election: true
14:23:02.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.589416 12622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.599049 12386 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [term 0 FOLLOWER]: Advancing to term 1
14:23:02.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.599354 12413 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: configured and running, proceeding with master startup.
14:23:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.614326 12622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.615607 12386 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [term 1 FOLLOWER]: Refusing update from remote peer c8c4c438782641df9e03e3cff14e134f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:02.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.617367 12584 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:02.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.634578 12367 tablet.cc:2404] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:02.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.740541 12622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8c4c438782641df9e03e3cff14e134f. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.741160 12622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.742125 12631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.742913 12631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:02.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:02.764082 12639 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:23:02.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.934520 12620 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:02.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.935425 12620 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:02.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.936336 12620 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:02.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.992560 12620 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:02.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:02.994130 12620 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.11.1
14:23:03.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114183030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:03.042 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:03.044 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:23:03.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.050290 12584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8c4c438782641df9e03e3cff14e134f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da71930aa874518b497ef6a68a4bdb8" member_type: VOTER last_known_addr { host: "127.12.11.62" port: 39875 } } peers { permanent_uuid: "c8c4c438782641df9e03e3cff14e134f" member_type: VOTER last_known_addr { host: "127.12.11.61" port: 45967 } } peers { permanent_uuid: "24d5afb6198f42eab8e57771a6fd824a" member_type: VOTER last_known_addr { host: "127.12.11.60" port: 37961 } } }
14:23:03.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.051807 12584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c4c438782641df9e03e3cff14e134f [sys.catalog]: This master's current role is: LEADER
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.054847 12620 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.1:0
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data/info.pb
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.1
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.1
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/logs
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:03.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.057487 12620 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:03.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.059523 12620 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:03.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.073973 12606 catalog_manager.cc:1295] Loaded cluster ID: 3ce6fec2f0ba47f9a955368f0eeb03ec
14:23:03.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.074298 12606 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: loading cluster ID for follower catalog manager: success
14:23:03.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:03.081771 12650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:03.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.086817 12606 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: acquiring CA information for follower catalog manager: success
14:23:03.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.092247 12606 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 24d5afb6198f42eab8e57771a6fd824a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:03.178 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.10.60.62:34681, [14ms] received response from server master-127.10.60.62:34681: OK, deferred=null) with no deferred attached!
14:23:03.181 [DEBUG - pool-14-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.10.60.62:34681, [4ms] received response from server master-127.10.60.62:34681: OK, deferred=null) with no deferred attached!
14:23:03.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114183530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:03.546 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
14:23:03.547 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:23:03.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.788321 12639 catalog_manager.cc:1295] Loaded cluster ID: 3ce6fec2f0ba47f9a955368f0eeb03ec
14:23:03.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.788817 12639 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: loading cluster ID for follower catalog manager: success
14:23:03.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.811792 12639 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: acquiring CA information for follower catalog manager: success
14:23:03.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:03.828960 12639 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 9da71930aa874518b497ef6a68a4bdb8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:04.016 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:04.017 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:04.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:04.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:04.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:04.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:04.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:04.018 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:04.017 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:04.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:04.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:04.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:04.019 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:04.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114184030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:04.045 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:23:04.047 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:23:04.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:04.482352 12649 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 12620
14:23:04.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:04.504518 12620 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.417s	user 0.269s	sys 0.466s
14:23:04.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:04.514832 12620 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.427s	user 0.269s	sys 0.467s
14:23:04.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:03.089073 12651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.530097 12620 server_base.cc:1061] running on GCE node
14:23:04.535 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114184531 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:04.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:04.542654 12656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:04.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.544082 12620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:04.552 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
14:23:04.553 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:23:04.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.574610 12620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:04.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.578310 12620 hybrid_clock.cc:648] HybridClock initialized: now 1779114184578258 us; error 52 us; skew 500 ppm
14:23:04.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.579402 12620 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:04.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.598737 12620 webserver.cc:533] Webserver started at http://127.12.11.1:36013/ using document root <none> and password file <none>
14:23:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.599838 12620 fs_manager.cc:362] Metadata directory not provided
14:23:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.600081 12620 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.600553 12620 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:04.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.606458 12620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data/instance:
14:23:04.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:04.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:04 on dist-test-slave-1n46"
14:23:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.607991 12620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal/instance:
14:23:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:04 on dist-test-slave-1n46"
14:23:04.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.620152 12620 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.005s	sys 0.005s
14:23:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.632862 12662 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:04.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.634069 12620 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.006s	sys 0.004s
14:23:04.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.634450 12620 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal
14:23:04.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:04.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:04 on dist-test-slave-1n46"
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.634840 12620 fs_report.cc:389] FS layout report
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data/data
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:04.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:04.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.754016 12620 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:04.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.757135 12620 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:04.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.757633 12620 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:04.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.770004 12620 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.783022 12620 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.783448 12620 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
14:23:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.783739 12620 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:04.783953 12620 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:05.030 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114185030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:05.048 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:23:05.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:23:05.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114185530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:05.548 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:23:05.550 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:23:05.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.615617 12775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.1:39911 every 8 connection(s)
14:23:05.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.616155 12620 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.1:39911
14:23:05.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.619902 12620 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/data/info.pb
14:23:05.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.621757 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12620
14:23:05.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.622368 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-0/wal/instance
14:23:05.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.635469 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:05.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:05.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal
14:23:05.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data
14:23:05.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/logs
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data/info.pb
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.2:0
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.2
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.2
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:05.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.721655 12776 heartbeater.cc:344] Connected to a master server at 127.12.11.60:37961
14:23:05.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.722209 12776 heartbeater.cc:461] Registering TS with master...
14:23:05.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.722960 12777 heartbeater.cc:344] Connected to a master server at 127.12.11.61:45967
14:23:05.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.723364 12777 heartbeater.cc:461] Registering TS with master...
14:23:05.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.723613 12776 heartbeater.cc:507] Master 127.12.11.60:37961 requested a full tablet report, sending...
14:23:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.724557 12777 heartbeater.cc:507] Master 127.12.11.61:45967 requested a full tablet report, sending...
14:23:05.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.729038 12454 ts_manager.cc:194] Registered new tserver with Master: e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911)
14:23:05.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.731496 12454 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.11.1:36849
14:23:05.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.733101 12537 ts_manager.cc:194] Registered new tserver with Master: e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911)
14:23:05.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.737331 12782 heartbeater.cc:344] Connected to a master server at 127.12.11.62:39875
14:23:05.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.737630 12782 heartbeater.cc:461] Registering TS with master...
14:23:05.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.738232 12782 heartbeater.cc:507] Master 127.12.11.62:39875 requested a full tablet report, sending...
14:23:05.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:05.740741 12378 ts_manager.cc:194] Registered new tserver with Master: e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911)
14:23:05.756 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [7ms] received response from server master-127.9.135.188:36123: OK, deferred=null) with no deferred attached!
14:23:06.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114186030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:06.043 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:23:06.045 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
14:23:06.096 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:06.097 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:06.098 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:06.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:06.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:06.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:06.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:06.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:06.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:06.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:06.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:06.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:06.102 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:06.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.270937 12783 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:06.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.271540 12783 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:06.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.272178 12783 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:06.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.313763 12783 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:06.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.314761 12783 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.11.2
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:06.351011 12783 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.2:0
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data/info.pb
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.2
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.2
14:23:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/logs
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:06.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:06.352399 12783 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:06.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:06.354298 12783 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:06.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.368709 12793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:06.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114186530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:06.547 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:23:06.549 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
14:23:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:06.735237 12777 heartbeater.cc:499] Master 127.12.11.61:45967 was elected leader, sending a full tablet report...
14:23:07.031 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114187030 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:07.041 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:23:07.042 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
14:23:07.531 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114187530 for job d754db15cc0c9bfa72479ca905ecb22a.
14:23:07.540 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job d754db15cc0c9bfa72479ca905ecb22a (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:23:07.541 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
14:23:07.556 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.557 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.558 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.558 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.558 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.558 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.559 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.559 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.560 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.561 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.561 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.561 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.563 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29829), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [3ms] received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [33ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [69ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [86ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [128ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [187ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [187ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [268ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [268ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [285ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [287ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [564ms] refreshing cache from master, [565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [567ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [568ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [568ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [569ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [570ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1484ms] refreshing cache from master, [1484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1487ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1487ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2984ms] refreshing cache from master, [2984ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2985ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2986ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2986ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2988ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2995ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2995ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5404ms] refreshing cache from master, [5404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5405ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5406ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5411ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [5412ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5413ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5413ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5904ms] refreshing cache from master, [5904ms] too many traces: truncated at 100 traces, deferred=Deferred@382641326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@3dd88124 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841)))
14:23:07.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.565 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29829), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [3ms] received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [33ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [69ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [86ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [128ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [187ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [187ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [268ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [268ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [285ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [287ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [564ms] refreshing cache from master, [565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [567ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [568ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [568ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [569ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [570ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1484ms] refreshing cache from master, [1484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1487ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1487ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2984ms] refreshing cache from master, [2984ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2985ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2986ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2986ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2988ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2995ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2995ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5404ms] refreshing cache from master, [5404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5405ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5406ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5411ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [5412ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5413ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5413ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5904ms] refreshing cache from master, [5904ms] too many traces: truncated at 100 traces, deferred=Deferred@382641326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@3dd88124 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29829), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [3ms] received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [33ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [69ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [86ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [128ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [187ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [187ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [268ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [268ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [285ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [287ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [564ms] refreshing cache from master, [565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [567ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [568ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [568ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [569ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [570ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1484ms] refreshing cache from master, [1484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1487ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1487ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2984ms] refreshing cache from master, [2984ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2985ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2986ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2986ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2988ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2995ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2995ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5404ms] refreshing cache from master, [5404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5405ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5406ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5411ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [5412ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5413ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5413ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5904ms] refreshing cache from master, [5904ms] too many traces: truncated at 100 traces, deferred=Deferred@382641326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@3dd88124 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:07.567 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.569 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.570 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.570 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.570 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.576 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.578 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.578 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.578 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.579 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.579 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.579 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.580 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.582 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.582 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.582 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.582 [WARN - pool-12-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.596 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.597 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.597 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.598 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.598 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.598 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.599 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.599 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.600 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.600 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.616 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.617 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.617 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.618 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.618 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.618 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.618 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.619 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.619 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.619 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.620 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.636 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.637 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.637 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.636 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29829), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [3ms] received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [33ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [69ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [86ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [128ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [187ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [187ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [268ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [268ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [285ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [287ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [564ms] refreshing cache from master, [565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [567ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [568ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [568ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [569ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [570ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1484ms] refreshing cache from master, [1484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1487ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1487ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2984ms] refreshing cache from master, [2984ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2985ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2986ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2986ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2988ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2995ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2995ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5404ms] refreshing cache from master, [5404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5405ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5406ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5411ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [5412ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5413ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5413ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5904ms] refreshing cache from master, [5904ms] too many traces: truncated at 100 traces, deferred=Deferred@382641326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@3dd88124 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29829), Traces: [0ms] sending RPC to server master-127.9.135.188:36123, [3ms] received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [33ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [69ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [86ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [86ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [126ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [128ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [187ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [187ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [268ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [268ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [285ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [286ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [287ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [564ms] refreshing cache from master, [565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [567ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [568ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [568ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [569ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [570ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1484ms] refreshing cache from master, [1484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1487ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1487ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2984ms] refreshing cache from master, [2984ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2985ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2986ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2986ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2988ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2995ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2995ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5404ms] refreshing cache from master, [5404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5405ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5406ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5411ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [5412ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5413ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5413ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5904ms] refreshing cache from master, [5904ms] too many traces: truncated at 100 traces, deferred=Deferred@382641326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@3dd88124 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@286189335 after retry RPC after error@1847394259) -> (continuation of Deferred@219467114 after retry RPC after error@1958521933) -> (continuation of Deferred@309123986 after retry RPC after error@453467243) -> (continuation of Deferred@810790396 after retry RPC after error@563913087) -> (continuation of Deferred@1431850645 after retry RPC after error@1948103761) -> (continuation of Deferred@1494010723 after retry RPC after error@501157476) -> (continuation of Deferred@182765484 after retry RPC after error@331498909) -> (continuation of Deferred@749392725 after retry RPC after error@1239630986) -> (continuation of Deferred@1695953853 after retry RPC after error@1685683247) -> (continuation of Deferred@515058574 after retry RPC after error@1294465990) -> (continuation of Deferred@427336196 after retry RPC after error@919547136) -> (continuation of Deferred@833064716 after retry RPC after error@1127004981) -> (continuation of Deferred@521689558 after retry RPC after error@1349570584) -> (continuation of Deferred@1570962165 after retry RPC after error@2071005031) -> (continuation of Deferred@645539638 after retry RPC after error@1893516273) -> (continuation of Deferred@979626573 after retry RPC after error@1230669913) -> (continuation of Deferred@1055802835 after retry RPC after error@683395764) -> (continuation of Deferred@221211756 after retry RPC after error@271201744) -> (continuation of Deferred@1554393819 after retry RPC after error@708748689) -> (continuation of Deferred@1543823542 after retry RPC after error@499243603) -> (continuation of Deferred@1885133762 after retry RPC after error@798091893) -> (continuation of Deferred@1424731745 after retry RPC after error@1206642157) -> (continuation of Deferred@1375712281 after retry RPC after error@1897741841)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:07.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.650 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:23:07.650 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:23:07.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
14:23:07.670 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:23:07.671 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:07.672 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:23:07.672 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:07.676 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.677 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.677 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.677 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.680 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state TERMINATED
14:23:07.680 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state TERMINATED
14:23:07.680 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state TERMINATED
14:23:07.682 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:07.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.683 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.690 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:07.691 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:07.727 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
14:23:07.734 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
14:23:07.734 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:07.736 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:23:07.736 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:07.727 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:23:07.737 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
14:23:07.738 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:23:07.738 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:23:07.738 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:23:07.738 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
14:23:07.739 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:07.739 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:23:07.739 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:07.742 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.743 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.744 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.744 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.744 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.745 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.745 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.751 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state TERMINATED
14:23:07.751 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 21245d28728c4865a9eca7be205d1a16(127.10.60.2:33545)] disconnecting while in state TERMINATED
14:23:07.751 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state TERMINATED
14:23:07.751 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state TERMINATED
14:23:07.751 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:07.752 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:07.752 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
14:23:07.753 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
14:23:07.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:07.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:23:07.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:07.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state TERMINATED
14:23:07.764 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state TERMINATED
14:23:07.764 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state TERMINATED
14:23:07.764 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:07.765 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
14:23:07.766 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:07.766 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:07.766 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:23:07.766 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:07.774 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.10.60.61:42317(127.10.60.61:42317)] disconnecting while in state TERMINATED
14:23:07.774 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.10.60.60:46387(127.10.60.60:46387)] disconnecting while in state TERMINATED
14:23:07.774 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9c08415addb64339a678077a5970c4e0(127.10.60.1:46175)] disconnecting while in state TERMINATED
14:23:07.774 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.10.60.62:34681(127.10.60.62:34681)] disconnecting while in state TERMINATED
14:23:07.774 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:07.775 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
14:23:07.775 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
14:23:07.776 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:23:07.799 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:23:07.799 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:07.800 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:23:07.800 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:07.800 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
14:23:07.800 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:23:07.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:07.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:23:07.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:07.802 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
14:23:07.804 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
14:23:07.804 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:07.805 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:23:07.805 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:07.805 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
14:23:07.814 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:23:07.816 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.816 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.817 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.818 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.818 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.818 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.818 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:07.836 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:07.839 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:23:07.839 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:07.840 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:23:07.846 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:07.850 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:23:07.851 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:23:07.876 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:07.876 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:07.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.877 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:07.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:07.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:07.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.879 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:07.879 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:08.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:07.769129 12792 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 12783
14:23:08.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.233773 12795 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1865 milliseconds
14:23:08.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:06.368858 12794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.240602 12783 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.872s	user 0.421s	sys 0.871s
14:23:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.235258 12796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.244526 12783 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.876s	user 0.422s	sys 0.872s
14:23:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.244859 12783 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:08.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.260222 12783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:08.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.270496 12783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:08.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.271945 12783 hybrid_clock.cc:648] HybridClock initialized: now 1779114188271830 us; error 110 us; skew 500 ppm
14:23:08.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.272969 12783 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:08.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.280591 12783 webserver.cc:533] Webserver started at http://127.12.11.2:33989/ using document root <none> and password file <none>
14:23:08.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.281661 12783 fs_manager.cc:362] Metadata directory not provided
14:23:08.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.281916 12783 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:08.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.282476 12783 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:08.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.288618 12783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data/instance:
14:23:08.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:08.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:08 on dist-test-slave-1n46"
14:23:08.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.289952 12783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal/instance:
14:23:08.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:08.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:08 on dist-test-slave-1n46"
14:23:08.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.299026 12783 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.006s
14:23:08.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.305136 12828 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:08.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.306223 12783 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.306646 12783 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:08 on dist-test-slave-1n46"
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.307086 12783 fs_report.cc:389] FS layout report
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data/data
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.357501 12783 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:08.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.359009 12783 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:08.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.359443 12783 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.361938 12783 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:08.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.366397 12783 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:08.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.366626 12783 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:08.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.366927 12783 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:08.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.367106 12783 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:08.376 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:08.377 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:08.377 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:08.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.378 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.378 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.377 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.378 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.378 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.378 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.378 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.379 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:08.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.502303 12783 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.2:40867
14:23:08.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.502389 12940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.2:40867 every 8 connection(s)
14:23:08.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.505185 12783 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/data/info.pb
14:23:08.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.514036 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12783
14:23:08.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.514644 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-1/wal/instance
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.554745 12332 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/logs
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data/info.pb
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.3:0
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.3
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.3
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:08.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.569730 12941 heartbeater.cc:344] Connected to a master server at 127.12.11.60:37961
14:23:08.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.570247 12941 heartbeater.cc:461] Registering TS with master...
14:23:08.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.571471 12941 heartbeater.cc:507] Master 127.12.11.60:37961 requested a full tablet report, sending...
14:23:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.574491 12537 ts_manager.cc:194] Registered new tserver with Master: b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:08.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.582886 12943 heartbeater.cc:344] Connected to a master server at 127.12.11.62:39875
14:23:08.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.583238 12943 heartbeater.cc:461] Registering TS with master...
14:23:08.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.583746 12942 heartbeater.cc:344] Connected to a master server at 127.12.11.61:45967
14:23:08.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.584138 12942 heartbeater.cc:461] Registering TS with master...
14:23:08.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.584283 12943 heartbeater.cc:507] Master 127.12.11.62:39875 requested a full tablet report, sending...
14:23:08.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.585027 12942 heartbeater.cc:507] Master 127.12.11.61:45967 requested a full tablet report, sending...
14:23:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.587436 12378 ts_manager.cc:194] Registered new tserver with Master: b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.587689 12454 ts_manager.cc:194] Registered new tserver with Master: b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.589571 12454 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.11.2:53087
14:23:08.776 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:08.777 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:08.777 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.777 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:08.777 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.778 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.778 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.778 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.778 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.778 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.879946 12951 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.880429 12951 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:08.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.880914 12951 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:08.887 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:23:08.889 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:23:08.904 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:23:08.905 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:23:08.907 [INFO - Thread-10] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:23:08.907 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:23:08.907 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:23:08.907 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:23:08.907 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:08.910 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
14:23:08.911 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
14:23:08.912 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:23:08.912 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:08.917 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:08.917 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
14:23:08.917 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:23:08.918 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:23:08.919 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:23:08.919 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:23:08.920 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:08.921 [INFO - Thread-10] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:23:08.921 [INFO - Thread-10] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:23:08.923 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
14:23:08.923 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:23:08.923 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:23:08.923 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
14:23:08.924 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
14:23:08.924 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17334ea0
14:23:08.924 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:08.925 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:08.925 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:23:08.926 [DEBUG - Thread-10] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:08.926 [INFO - Thread-10] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:23:08.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.927069 12951 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:08.927 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:23:08.928 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:08.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:08.928336 12951 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.11.3
14:23:08.929 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
14:23:08.929 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:23:08.929 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
14:23:08.930 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:23:08.931 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1eb63e0a
14:23:08.932 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:23:08.934 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
14:23:08.934 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:23:08.934 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:23:08.936 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:08.937 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:08.937 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:08.937 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:08.937 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:08.937 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:23:08.938 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:23:08.939 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:23:08.939 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:23:08.939 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:23:08.939 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7491e70e
14:23:08.939 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:23:08.939 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:08.940 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:08.940 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:23:08.940 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:23:08.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
14:23:08.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
14:23:08.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f6b173d
14:23:08.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:08.942 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:08.942 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:23:08.942 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b8dc0d6
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cdd68b7
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:08.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:08.948 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:23:08.948 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:23:08.950 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:08.952 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f2c9559
14:23:08.952 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:08.954 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:08.954 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:08.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@179a84df
14:23:08.957 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:08.957 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:08.958 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.959 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:08.960 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:08.961 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:08.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.964 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:08.964 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:08.965 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.966 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:08.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.970 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:08.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.971 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:08.971 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:08.971 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.972 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.972 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:08.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.975 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.978 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:08.978 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.978 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.978 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:08.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.979 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:08.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:08.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.982 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:08.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.983 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:08.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.985 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:08.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:08.987 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.990247 12951 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.11.20:46345
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.11.3:0
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data/info.pb
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.11.3
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.11.62:39875,127.12.11.61:45967,127.12.11.60:37961
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.11.3
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/logs
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:08.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:08.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.991967 12951 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:08.992 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:08.993 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:08.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:08.994128 12951 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:08.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:08.995 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:08.995 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:08.996 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:08.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.997 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.997 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:08.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:08.998 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:08.999 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:08.999 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.000 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.000 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.000 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.000 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.001 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.002 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.002 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.002 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.002 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.002 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.003 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.003 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.004 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.004 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.004 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.004 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.005 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.005 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.011 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.012 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:09.012876 12998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:09.013 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.015 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.016 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.018 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.019 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.020 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.024 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.034 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.035 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.036 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.037 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.038 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.039 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.039 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.039 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.039 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.040 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.041 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.043 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.044 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.045 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.045 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.052 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.052 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.053 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.054 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.054 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.054 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.055 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.055 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.055 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.055 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.055 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.055 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.055 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.056 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.056 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.057 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.060 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.060 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.060 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.062 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.062 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.063 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.063 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.072 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.073 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.073 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.074 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.074 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.074 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.077 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.085 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.085 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.086 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.086 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.087 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.089 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.089 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.089 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.092 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.092 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.093 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.088 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.102 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.102 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.102 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.103 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.107 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.108 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.109 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.109 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.109 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.109 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.109 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.110 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.112 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.112 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.112 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.113 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.113 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.113 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.113 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.116 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.122 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.124 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.124 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.125 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.126 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.126 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.126 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.126 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.134 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.134 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.135 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.135 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.135 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.135 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.137 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.137 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.137 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.137 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.138 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.138 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.138 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.139 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.139 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.140 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.141 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.145 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.145 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.146 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.148 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.148 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.148 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.148 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.154 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.155 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.155 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.155 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.161 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.161 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.162 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.166 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.167 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:09.181 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.181 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.182 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.183 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.183 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.183 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.184 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.184 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.185 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.185 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.185 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.185 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.185 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.186 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.186 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.186 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.194 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.194 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.195 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.196 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.196 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.196 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.196 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.196 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.196 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.196 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.214 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.214 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.215 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.215 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.216 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.216 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.216 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.220 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.221 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.221 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.224 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.224 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.244 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.244 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.245 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.246 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.247 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.247 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.247 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.248 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.255 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.255 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.256 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.256 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.256 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.256 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.256 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.256 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.256 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.257 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.257 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.280 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.281 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.281 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.282 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.282 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.284 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.333 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.339 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.339 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.339 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.340 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.340 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.342 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:09.345 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.345 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.346 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.347 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.347 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.347 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.347 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.400 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.401 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.406 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.408 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.408 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.409 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.409 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.409 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.409 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.455 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.456 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.456 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.457 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.458 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.459 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.461 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.461 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.462 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.462 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.462 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.463 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.464 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.484 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.485 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.485 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.486 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.486 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.487 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.487 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.487 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.488 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.488 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.488 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.515 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.516 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.516 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.517 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.517 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.517 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.517 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.518 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.518 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.518 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.524 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.525 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.525 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.525 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.525 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.525 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.525 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.526 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.526 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.526 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.526 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.535 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.535 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.535 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.535 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.535 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.536 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.536 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.536 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.536 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.537 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.582 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:09.582 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:09.583 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:09.584 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.584 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.584 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:09.585 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:09.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:09.586 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:09.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:09.592679 12942 heartbeater.cc:499] Master 127.12.11.61:45967 was elected leader, sending a full tablet report...
14:23:09.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:09.673 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:09.673 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:09.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:09.675 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:09.676 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.676 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:09.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.677 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:09.677 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:10.004 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.005 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.006 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.006 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.007 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.080111 12568 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7700 after lost signal to thread 12496
14:23:10.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.091626 12568 debug-util.cc:398] Leaking SignalData structure 0x7b08000b76e0 after lost signal to thread 12571
14:23:10.102 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.103 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.120 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.121 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.121 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.121 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.121 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.122 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.122 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.132 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:10.132 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:10.133 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:10.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:10.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:10.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:10.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:10.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:10.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:10.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:10.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:10.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:10.135 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:10.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:10.181 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.182 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.182 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.183 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.186 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.186 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.186 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.186 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.260 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.261 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.261 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.263 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.300 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.301 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.301 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.302 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.302 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.425 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.426 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.426 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.427 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.429 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.460 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.461 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.462 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.465 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.465 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.465 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.414649 12997 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 12951
14:23:10.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.619107 12951 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.602s	user 0.491s	sys 0.948s
14:23:10.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.620812 12951 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.604s	user 0.491s	sys 0.948s
14:23:10.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.621098 12951 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:10.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.621114 13004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:10.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:10.619837 13001 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1602 milliseconds
14:23:10.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:09.017645 12999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:10.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.627427 12951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:10.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.630362 12951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:10.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.631762 12951 hybrid_clock.cc:648] HybridClock initialized: now 1779114190631722 us; error 48 us; skew 500 ppm
14:23:10.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.632606 12951 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:10.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.638980 12951 webserver.cc:533] Webserver started at http://127.12.11.3:46627/ using document root <none> and password file <none>
14:23:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.639860 12951 fs_manager.cc:362] Metadata directory not provided
14:23:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.640077 12951 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.640574 12951 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.645174 12951 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data/instance:
14:23:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43408dde659b44f5a0f27fdd2a5a1f97"
14:23:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:10 on dist-test-slave-1n46"
14:23:10.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.646283 12951 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal/instance:
14:23:10.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43408dde659b44f5a0f27fdd2a5a1f97"
14:23:10.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:10 on dist-test-slave-1n46"
14:23:10.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.652848 12951 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
14:23:10.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.658680 13025 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:10.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.659713 12951 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:23:10.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.660091 12951 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal
14:23:10.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43408dde659b44f5a0f27fdd2a5a1f97"
14:23:10.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:10 on dist-test-slave-1n46"
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.660506 12951 fs_report.cc:389] FS layout report
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data/data
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:10.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:10.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:10.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.722369 12951 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:10.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.724102 12951 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:10.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.724630 12951 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.730192 12951 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.735308 12951 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.735553 12951 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:10.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.735821 12951 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:10.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.736025 12951 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:10.820 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.820 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.821 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.824 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.901 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:10.902 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:10.902 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:10.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:10.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:10.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:10.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:10.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.918860 12951 rpc_server.cc:307] RPC server started. Bound to: 127.12.11.3:46811
14:23:10.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.919030 13137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.11.3:46811 every 8 connection(s)
14:23:10.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.921615 12951 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/data/info.pb
14:23:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.930882 12332 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 12951
14:23:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.931435 12332 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14432764074926203538/ts-2/wal/instance
14:23:10.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.972236 13139 heartbeater.cc:344] Connected to a master server at 127.12.11.61:45967
14:23:10.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.972682 13139 heartbeater.cc:461] Registering TS with master...
14:23:10.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.976619 13138 heartbeater.cc:344] Connected to a master server at 127.12.11.60:37961
14:23:10.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.976975 13138 heartbeater.cc:461] Registering TS with master...
14:23:10.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.977699 13140 heartbeater.cc:344] Connected to a master server at 127.12.11.62:39875
14:23:10.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.978035 13140 heartbeater.cc:461] Registering TS with master...
14:23:10.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.978226 13138 heartbeater.cc:507] Master 127.12.11.60:37961 requested a full tablet report, sending...
14:23:10.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.979079 13140 heartbeater.cc:507] Master 127.12.11.62:39875 requested a full tablet report, sending...
14:23:10.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.981449 12537 ts_manager.cc:194] Registered new tserver with Master: 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.983444 13139 heartbeater.cc:507] Master 127.12.11.61:45967 requested a full tablet report, sending...
14:23:10.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.990430 12454 ts_manager.cc:194] Registered new tserver with Master: 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:10.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.992949 12378 ts_manager.cc:194] Registered new tserver with Master: 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:10.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:10.991958 12454 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.11.3:45211
14:23:11.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.015264 12332 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:23:11.027 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:23:11.027 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:23:11.028 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.11.62"
      port: 39875
    }
    bound_http_address {
      host: "127.12.11.62"
      port: 45881
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.12.11.61"
      port: 45967
    }
    bound_http_address {
      host: "127.12.11.61"
      port: 36989
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.12.11.60"
      port: 37961
    }
    bound_http_address {
      host: "127.12.11.60"
      port: 42395
    }
  }
}

14:23:11.029 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:23:11.030 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.11.1"
      port: 39911
    }
    bound_http_address {
      host: "127.12.11.1"
      port: 36013
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.12.11.2"
      port: 40867
    }
    bound_http_address {
      host: "127.12.11.2"
      port: 33989
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.12.11.3"
      port: 46811
    }
    bound_http_address {
      host: "127.12.11.3"
      port: 46627
    }
  }
}

14:23:11.030 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:23:11.033 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:11.040 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:11.041 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:11.042 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:11.044 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.83.188:44337(127.11.83.188:44337)] Successfully connected to peer
14:23:11.046 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.83.189:34071(127.11.83.189:34071)] Successfully connected to peer
14:23:11.057 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.189
14:23:11.062 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.83.190:41547(127.11.83.190:41547)] Successfully connected to peer
14:23:11.075 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.188
14:23:11.076 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.190
14:23:11.086 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:11.096 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:11.097 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc78bae67, L:/127.0.0.1:51444 - R:/127.11.83.189:34071] using SASL/PLAIN
14:23:11.099 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:11.102 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc941782d, L:/127.0.0.1:59298 - R:/127.11.83.188:44337] using SASL/PLAIN
14:23:11.106 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdc2a564a, L:/127.0.0.1:38582 - R:/127.11.83.190:41547] using SASL/PLAIN
14:23:11.106 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:11.106 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=67), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: OK, deferred=null) after lookup
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.110064 11801 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59298:
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:11.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:11.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.115403 11801 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:23:11.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:11.235 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:11.341 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:11.341 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:11.342 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:11.342 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.342 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.342 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.343 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.343 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.343 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.344 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:11.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.376075 11974 tablet_service.cc:1511] Processing CreateTablet for tablet c727d8dcd101499c83395f60403d724d (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.381093 12115 tablet_service.cc:1511] Processing CreateTablet for tablet e114fea09fd44768885e5a039ff61762 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.382580 12113 tablet_service.cc:1511] Processing CreateTablet for tablet 2c42eaec0d824e86a11149430f2d1456 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.381230 12116 tablet_service.cc:1511] Processing CreateTablet for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.384436 12114 tablet_service.cc:1511] Processing CreateTablet for tablet 8479b7c28d58460a94f7a9353d62fda7 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.378695 11970 tablet_service.cc:1511] Processing CreateTablet for tablet 2c42eaec0d824e86a11149430f2d1456 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.385509 12117 tablet_service.cc:1511] Processing CreateTablet for tablet c727d8dcd101499c83395f60403d724d (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.386348 11970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c42eaec0d824e86a11149430f2d1456. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.386864 12115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e114fea09fd44768885e5a039ff61762. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.380216 11972 tablet_service.cc:1511] Processing CreateTablet for tablet e114fea09fd44768885e5a039ff61762 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.390004 11972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e114fea09fd44768885e5a039ff61762. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.381816 11971 tablet_service.cc:1511] Processing CreateTablet for tablet 8479b7c28d58460a94f7a9353d62fda7 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.392016 11971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8479b7c28d58460a94f7a9353d62fda7. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.383735 11973 tablet_service.cc:1511] Processing CreateTablet for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.395253 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.395465 12254 tablet_service.cc:1511] Processing CreateTablet for tablet 8479b7c28d58460a94f7a9353d62fda7 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.397199 12256 tablet_service.cc:1511] Processing CreateTablet for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.397682 12253 tablet_service.cc:1511] Processing CreateTablet for tablet 2c42eaec0d824e86a11149430f2d1456 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.395857 12255 tablet_service.cc:1511] Processing CreateTablet for tablet e114fea09fd44768885e5a039ff61762 (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.399063 12256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.405171 12255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e114fea09fd44768885e5a039ff61762. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.405339 12257 tablet_service.cc:1511] Processing CreateTablet for tablet c727d8dcd101499c83395f60403d724d (DEFAULT_TABLE table=replication_test_table [id=e992eac740c34f82a67ed784413d9dc9]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.406538 12257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727d8dcd101499c83395f60403d724d. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.407302 12253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c42eaec0d824e86a11149430f2d1456. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.408929 12254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8479b7c28d58460a94f7a9353d62fda7. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.410493 12114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8479b7c28d58460a94f7a9353d62fda7. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.412344 12116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466db4c4ffe14cf48387c9ef2e2e7bdb. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.414304 12113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c42eaec0d824e86a11149430f2d1456. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.415 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:11.415 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:11.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.416 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:11.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.416473 12117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727d8dcd101499c83395f60403d724d. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.417 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.417 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.417 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:11.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.418457 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727d8dcd101499c83395f60403d724d. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:11.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.480894 13174 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: Bootstrap starting.
14:23:11.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.487181 13175 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Bootstrap starting.
14:23:11.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.494486 13174 tablet_bootstrap.cc:654] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: Neither blocks nor log segments found. Creating new log.
14:23:11.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.496793 13175 tablet_bootstrap.cc:654] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Neither blocks nor log segments found. Creating new log.
14:23:11.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.496796 13174 log.cc:826] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: Log is configured to *not* fsync() on all Append() calls
14:23:11.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.499707 13175 log.cc:826] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Log is configured to *not* fsync() on all Append() calls
14:23:11.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.511528 13175 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: No bootstrap required, opened a new log
14:23:11.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.512210 13175 ts_tablet_manager.cc:1403] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
14:23:11.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.518954 13174 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: No bootstrap required, opened a new log
14:23:11.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.519436 13174 ts_tablet_manager.cc:1403] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.010s
14:23:11.520 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:11.521 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:11.521 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:11.522 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.522 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.522 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.523 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.523 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.523 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.523 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.523 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.523 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.523 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:11.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.540313 13175 raft_consensus.cc:359] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.541441 13175 raft_consensus.cc:385] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.541841 13175 raft_consensus.cc:740] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Initialized, Role: FOLLOWER
14:23:11.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.543012 13175 consensus_queue.cc:260] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.553856 13175 ts_tablet_manager.cc:1434] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent starting tablet: real 0.041s	user 0.028s	sys 0.009s
14:23:11.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.556196 13175 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3: Bootstrap starting.
14:23:11.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.562180 13175 tablet_bootstrap.cc:654] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3: Neither blocks nor log segments found. Creating new log.
14:23:11.572 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:11.573 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:11.573 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:11.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:11.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:11.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:11.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:11.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:11.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:11.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:11.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:11.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:11.575 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.575112 13174 raft_consensus.cc:359] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.576045 13174 raft_consensus.cc:385] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.576355 13174 raft_consensus.cc:740] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Initialized, Role: FOLLOWER
14:23:11.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.577793 13175 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3: No bootstrap required, opened a new log
14:23:11.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.578377 13175 ts_tablet_manager.cc:1403] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
14:23:11.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.578879 13174 consensus_queue.cc:260] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.581061 13175 raft_consensus.cc:359] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.581815 13175 raft_consensus.cc:385] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.582168 13175 raft_consensus.cc:740] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Initialized, Role: FOLLOWER
14:23:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.582744 13175 consensus_queue.cc:260] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.587982 13175 ts_tablet_manager.cc:1434] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
14:23:11.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.588905 13175 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3: Bootstrap starting.
14:23:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.596606 13174 ts_tablet_manager.cc:1434] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent starting tablet: real 0.077s	user 0.023s	sys 0.012s
14:23:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.596649 13175 tablet_bootstrap.cc:654] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3: Neither blocks nor log segments found. Creating new log.
14:23:11.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.609290 13174 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b: Bootstrap starting.
14:23:11.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.611743 13175 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3: No bootstrap required, opened a new log
14:23:11.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.612315 13175 ts_tablet_manager.cc:1403] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.012s
14:23:11.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.615151 13175 raft_consensus.cc:359] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.616112 13175 raft_consensus.cc:385] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.616503 13175 raft_consensus.cc:740] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Initialized, Role: FOLLOWER
14:23:11.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.617609 13174 tablet_bootstrap.cc:654] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b: Neither blocks nor log segments found. Creating new log.
14:23:11.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.617321 13175 consensus_queue.cc:260] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.625362 13175 ts_tablet_manager.cc:1434] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
14:23:11.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.627166 13175 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Bootstrap starting.
14:23:11.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.633343 13175 tablet_bootstrap.cc:654] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Neither blocks nor log segments found. Creating new log.
14:23:11.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.640700 13174 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b: No bootstrap required, opened a new log
14:23:11.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.641067 13174 ts_tablet_manager.cc:1403] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
14:23:11.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.643719 13174 raft_consensus.cc:359] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.644382 13174 raft_consensus.cc:385] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.644676 13174 raft_consensus.cc:740] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Initialized, Role: FOLLOWER
14:23:11.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.645373 13174 consensus_queue.cc:260] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.656136 13174 ts_tablet_manager.cc:1434] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
14:23:11.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.667158 13174 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Bootstrap starting.
14:23:11.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.669682 13184 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Bootstrap starting.
14:23:11.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.670877 12047 tablet.cc:2404] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:11.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.673161 13174 tablet_bootstrap.cc:654] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Neither blocks nor log segments found. Creating new log.
14:23:11.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:11.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.675664 13180 raft_consensus.cc:493] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.676414 13180 raft_consensus.cc:515] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.681555 13178 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.682159 13178 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.692518 13180 leader_election.cc:290] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.715600 13178 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:11.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.728363 13178 raft_consensus.cc:493] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.728794 13178 raft_consensus.cc:515] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.730405 13178 leader_election.cc:290] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:11.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.734342 13184 tablet_bootstrap.cc:654] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Neither blocks nor log segments found. Creating new log.
14:23:11.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.737329 13184 log.cc:826] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Log is configured to *not* fsync() on all Append() calls
14:23:11.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.740447 13174 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: No bootstrap required, opened a new log
14:23:11.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.740844 13174 ts_tablet_manager.cc:1403] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent bootstrapping tablet: real 0.074s	user 0.036s	sys 0.033s
14:23:11.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.742630 13175 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3: No bootstrap required, opened a new log
14:23:11.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.743155 13175 ts_tablet_manager.cc:1403] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.024s
14:23:11.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.743377 13174 raft_consensus.cc:359] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.744016 13174 raft_consensus.cc:385] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.744292 13174 raft_consensus.cc:740] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Initialized, Role: FOLLOWER
14:23:11.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.744906 13174 consensus_queue.cc:260] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.749743 13174 ts_tablet_manager.cc:1434] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
14:23:11.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.750679 13174 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b: Bootstrap starting.
14:23:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.756958 13174 tablet_bootstrap.cc:654] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b: Neither blocks nor log segments found. Creating new log.
14:23:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.770239 13174 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b: No bootstrap required, opened a new log
14:23:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.770619 13174 ts_tablet_manager.cc:1403] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
14:23:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.772430 13180 raft_consensus.cc:493] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.772826 13180 raft_consensus.cc:515] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.774493 13180 leader_election.cc:290] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.776813 13174 raft_consensus.cc:359] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.777455 13174 raft_consensus.cc:385] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.777712 13174 raft_consensus.cc:740] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Initialized, Role: FOLLOWER
14:23:11.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.785331 12329 tablet.cc:2404] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:11.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.785032 13174 consensus_queue.cc:260] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.786751 13174 ts_tablet_manager.cc:1434] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
14:23:11.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.786577 13175 raft_consensus.cc:359] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.787199 13175 raft_consensus.cc:385] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.787519 13174 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b: Bootstrap starting.
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.787463 13175 raft_consensus.cc:740] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Initialized, Role: FOLLOWER
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.792635 13184 tablet_bootstrap.cc:492] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: No bootstrap required, opened a new log
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.793159 13184 ts_tablet_manager.cc:1403] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.006s
14:23:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.793665 13174 tablet_bootstrap.cc:654] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b: Neither blocks nor log segments found. Creating new log.
14:23:11.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.800069 13180 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.800459 13180 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.802076 13180 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.788038 13175 consensus_queue.cc:260] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.810318 12277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b" is_pre_election: true
14:23:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.811020 12277 raft_consensus.cc:2468] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in term 0.
14:23:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.812562 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b" is_pre_election: true
14:23:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.814338 11994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.815132 11994 raft_consensus.cc:2468] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 0.
14:23:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.815636 11927 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:11.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.817263 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:11.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.819640 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:11.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.820103 11993 raft_consensus.cc:2468] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 0.
14:23:11.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.821332 12213 leader_election.cc:304] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:11.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.821988 13180 raft_consensus.cc:2804] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:11.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.822270 13180 raft_consensus.cc:493] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:11.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.822556 13180 raft_consensus.cc:3060] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Advancing to term 1
14:23:11.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.826330 12213 leader_election.cc:343] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.827848 12213 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:11.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.833230 13180 raft_consensus.cc:515] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.835007 13180 leader_election.cc:290] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Requested vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.835523 13180 raft_consensus.cc:2804] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:11.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.835810 13180 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:11.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.836117 13180 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Advancing to term 1
14:23:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.840737 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:23:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.841255 11993 raft_consensus.cc:3060] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Advancing to term 1
14:23:11.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.807171 12137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.807992 12136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.858516 11926 leader_election.cc:343] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.859196 11926 leader_election.cc:343] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.860831 11993 raft_consensus.cc:2468] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 1.
14:23:11.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.871228 12213 leader_election.cc:304] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:11.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.872013 13194 raft_consensus.cc:2804] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election won for term 1
14:23:11.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.878481 13178 raft_consensus.cc:2804] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:11.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.878783 13178 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:11.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.879087 13178 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Advancing to term 1
14:23:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.887185 13178 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.888700 13178 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:11.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.899147 12136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:11.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.899708 13175 ts_tablet_manager.cc:1434] T e114fea09fd44768885e5a039ff61762 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent starting tablet: real 0.156s	user 0.006s	sys 0.000s
14:23:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.901808 13175 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Bootstrap starting.
14:23:11.902 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:11.903 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:11.903 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:11.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:11.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:11.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:11.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:11.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.909192 12137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.910287 11926 leader_election.cc:343] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.910390 12136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.910534 12135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.911478 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:11.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.913450 12210 leader_election.cc:343] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.913877 12210 leader_election.cc:304] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b; no voters: 08b2c86b157d47fbbfaa5d11dcd304f0, bf18c755793a4c3bb04fd7fcb4a3a3c3
14:23:11.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.928727 12210 leader_election.cc:343] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.929572 12210 leader_election.cc:343] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.930362 12210 leader_election.cc:343] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.932356 13184 raft_consensus.cc:359] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.933243 13184 raft_consensus.cc:385] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.933657 13174 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b: No bootstrap required, opened a new log
14:23:11.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.933550 13184 raft_consensus.cc:740] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Initialized, Role: FOLLOWER
14:23:11.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.934140 13174 ts_tablet_manager.cc:1403] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b: Time spent bootstrapping tablet: real 0.147s	user 0.055s	sys 0.049s
14:23:11.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.936882 13174 raft_consensus.cc:359] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.937472 13174 raft_consensus.cc:385] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:11.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.928742 13198 raft_consensus.cc:493] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.937728 13174 raft_consensus.cc:740] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Initialized, Role: FOLLOWER
14:23:11.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.938783 13198 raft_consensus.cc:515] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.938982 13174 consensus_queue.cc:260] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.941129 13195 raft_consensus.cc:2749] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:23:11.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.943549 13180 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.943967 13174 ts_tablet_manager.cc:1434] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
14:23:11.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.951035 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727d8dcd101499c83395f60403d724d" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:11.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.952504 12210 leader_election.cc:343] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.953433 13194 raft_consensus.cc:697] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Becoming Leader. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Running, Role: LEADER
14:23:11.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.954052 13198 leader_election.cc:290] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.954752 13194 consensus_queue.cc:237] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.950704 11994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727d8dcd101499c83395f60403d724d" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:11.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.958848 11994 raft_consensus.cc:2468] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 0.
14:23:11.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.959836 12213 leader_election.cc:304] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 08b2c86b157d47fbbfaa5d11dcd304f0
14:23:11.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.960512 13198 raft_consensus.cc:2804] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:11.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.949620 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:23:11.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.960961 13198 raft_consensus.cc:493] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:11.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.961457 13198 raft_consensus.cc:3060] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Advancing to term 1
14:23:11.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.966109 11993 raft_consensus.cc:2393] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 645f513b6cfd479a9020a5b95e6ce42b in current term 1: Already voted for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in this term.
14:23:11.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.961069 11927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.83.131:33751, user_credentials={real_user=slave}} blocked reactor thread for 145677us
14:23:11.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.967963 11927 leader_election.cc:343] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.968473 11927 leader_election.cc:304] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 08b2c86b157d47fbbfaa5d11dcd304f0, 645f513b6cfd479a9020a5b95e6ce42b
14:23:11.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.968356 13198 raft_consensus.cc:515] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:11.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.969523 13197 raft_consensus.cc:2749] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:23:11.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.971516 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:23:11.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.972286 12276 raft_consensus.cc:2393] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in current term 1: Already voted for candidate 645f513b6cfd479a9020a5b95e6ce42b in this term.
14:23:11.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.972627 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:11.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.970896 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727d8dcd101499c83395f60403d724d" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:23:11.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.973317 11993 raft_consensus.cc:3060] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Advancing to term 1
14:23:11.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.973980 11927 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 08b2c86b157d47fbbfaa5d11dcd304f0, 645f513b6cfd479a9020a5b95e6ce42b
14:23:11.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.974615 13180 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Requested vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:11.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.975378 13197 raft_consensus.cc:2749] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
14:23:11.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.977185 12135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727d8dcd101499c83395f60403d724d" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:11.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.979625 13184 consensus_queue.cc:260] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.980648 12134 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Advancing to term 1
14:23:11.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.982098 13175 tablet_bootstrap.cc:654] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Neither blocks nor log segments found. Creating new log.
14:23:11.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.987643 12134 raft_consensus.cc:2468] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 1.
14:23:11.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.991689 13199 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:11.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.992144 13199 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:11.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:11.978724 12210 leader_election.cc:343] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Illegal state: must be running to vote when last-logged opid is not known
14:23:11.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.994627 12210 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08b2c86b157d47fbbfaa5d11dcd304f0, 645f513b6cfd479a9020a5b95e6ce42b; no voters: bf18c755793a4c3bb04fd7fcb4a3a3c3
14:23:11.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.997045 13139 heartbeater.cc:499] Master 127.12.11.61:45967 was elected leader, sending a full tablet report...
14:23:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.996595 13180 raft_consensus.cc:2804] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election won for term 1
14:23:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.999991 13180 raft_consensus.cc:697] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Becoming Leader. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Running, Role: LEADER
14:23:12.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:11.997972 13198 leader_election.cc:290] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Requested vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:12.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.001430 13180 consensus_queue.cc:237] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.008446 13199 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:12.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.054905 13175 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3: No bootstrap required, opened a new log
14:23:12.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.055382 13175 ts_tablet_manager.cc:1403] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.010s
14:23:12.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.058272 13175 raft_consensus.cc:359] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.041060 11801 catalog_manager.cc:5697] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b reported cstate change: term changed from 0 to 1, leader changed from <none> to 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131). New cstate: current_term: 1 leader_uuid: "645f513b6cfd479a9020a5b95e6ce42b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } health_report { overall_health: HEALTHY } } }
14:23:12.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.058952 13175 raft_consensus.cc:385] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:12.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.059247 13175 raft_consensus.cc:740] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Initialized, Role: FOLLOWER
14:23:12.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.062870 11993 raft_consensus.cc:2468] T c727d8dcd101499c83395f60403d724d P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 1.
14:23:12.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.063971 12213 leader_election.cc:304] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 08b2c86b157d47fbbfaa5d11dcd304f0
14:23:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.065102 13194 raft_consensus.cc:2804] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election won for term 1
14:23:12.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.065536 13194 raft_consensus.cc:697] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Becoming Leader. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Running, Role: LEADER
14:23:12.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.066433 13194 consensus_queue.cc:237] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:12.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.046756 13184 ts_tablet_manager.cc:1434] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent starting tablet: real 0.253s	user 0.038s	sys 0.010s
14:23:12.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.082885 13184 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0: Bootstrap starting.
14:23:12.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.108775 13175 consensus_queue.cc:260] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.111231 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.116432 11993 raft_consensus.cc:2468] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08b2c86b157d47fbbfaa5d11dcd304f0 in term 1.
14:23:12.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.117492 12073 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b2c86b157d47fbbfaa5d11dcd304f0, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:12.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.118953 13199 raft_consensus.cc:2804] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:23:12.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.119297 13199 raft_consensus.cc:493] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:12.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.119642 13199 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Advancing to term 2
14:23:12.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.128928 13175 ts_tablet_manager.cc:1434] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
14:23:12.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.133201 13184 tablet_bootstrap.cc:654] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0: Neither blocks nor log segments found. Creating new log.
14:23:12.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.144382 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b" is_pre_election: true
14:23:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.154042 13199 raft_consensus.cc:515] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.161201 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:23:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.161821 11993 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Advancing to term 2
14:23:12.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.165725 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c42eaec0d824e86a11149430f2d1456" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:23:12.171 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:12.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.174216 11993 raft_consensus.cc:2468] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08b2c86b157d47fbbfaa5d11dcd304f0 in term 2.
14:23:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.175431 12073 leader_election.cc:304] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08b2c86b157d47fbbfaa5d11dcd304f0, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 645f513b6cfd479a9020a5b95e6ce42b
14:23:12.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.176653 13202 raft_consensus.cc:2804] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 2 FOLLOWER]: Leader election won for term 2
14:23:12.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.191444 13199 leader_election.cc:290] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 2 election: Requested vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:12.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.193948 13202 raft_consensus.cc:697] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 2 LEADER]: Becoming Leader. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Running, Role: LEADER
14:23:12.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.195142 13202 consensus_queue.cc:237] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.200572 13184 tablet_bootstrap.cc:492] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0: No bootstrap required, opened a new log
14:23:12.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.204521 13184 ts_tablet_manager.cc:1403] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.003s
14:23:12.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.207805 13184 raft_consensus.cc:359] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.222839 13184 raft_consensus.cc:385] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.226255 11800 catalog_manager.cc:5697] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130). New cstate: current_term: 2 leader_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } health_report { overall_health: UNKNOWN } } }
14:23:12.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.234488 13184 raft_consensus.cc:740] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Initialized, Role: FOLLOWER
14:23:12.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:12.234680 12189 tablet.cc:2404] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.244284 13184 consensus_queue.cc:260] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.251204 13184 ts_tablet_manager.cc:1434] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
14:23:12.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.263115 11801 catalog_manager.cc:5697] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b reported cstate change: term changed from 0 to 1, leader changed from <none> to 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131). New cstate: current_term: 1 leader_uuid: "645f513b6cfd479a9020a5b95e6ce42b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } health_report { overall_health: UNKNOWN } } }
14:23:12.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.278019 13184 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0: Bootstrap starting.
14:23:12.281 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:12.281 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:12.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:12.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:12.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:12.283 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:12.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:12.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:12.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:12.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:12.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:12.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:12.285 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:12.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.301798 13184 tablet_bootstrap.cc:654] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0: Neither blocks nor log segments found. Creating new log.
14:23:12.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.324378 13184 tablet_bootstrap.cc:492] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0: No bootstrap required, opened a new log
14:23:12.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.324842 13184 ts_tablet_manager.cc:1403] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.003s
14:23:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.327723 13184 raft_consensus.cc:359] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.330248 13184 raft_consensus.cc:385] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.330549 13184 raft_consensus.cc:740] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Initialized, Role: FOLLOWER
14:23:12.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.333976 13184 consensus_queue.cc:260] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.349422 13184 ts_tablet_manager.cc:1434] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
14:23:12.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.356117 13184 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0: Bootstrap starting.
14:23:12.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.378144 13184 tablet_bootstrap.cc:654] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0: Neither blocks nor log segments found. Creating new log.
14:23:12.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:12.381129 12210 consensus_peers.cc:597] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b -> Peer 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593): Couldn't send request to peer 08b2c86b157d47fbbfaa5d11dcd304f0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
14:23:12.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.386713 12134 raft_consensus.cc:1240] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 2 LEADER]: Rejecting Update request from peer 645f513b6cfd479a9020a5b95e6ce42b for earlier term 1. Current term is 2. Ops: []
14:23:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.388357 13180 consensus_queue.cc:1059] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.389068 13180 consensus_queue.cc:1243] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Peer 08b2c86b157d47fbbfaa5d11dcd304f0 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
14:23:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.389493 13180 raft_consensus.cc:3055] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Stepping down as leader of term 1
14:23:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.389782 13180 raft_consensus.cc:740] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Running, Role: LEADER
14:23:12.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.390506 13180 consensus_queue.cc:260] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.392159 13180 raft_consensus.cc:3060] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Advancing to term 2
14:23:12.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.401952 13184 tablet_bootstrap.cc:492] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0: No bootstrap required, opened a new log
14:23:12.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.402657 13184 ts_tablet_manager.cc:1403] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.004s
14:23:12.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.405542 13184 raft_consensus.cc:359] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:12.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.408521 13184 raft_consensus.cc:385] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:12.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.408916 13184 raft_consensus.cc:740] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Initialized, Role: FOLLOWER
14:23:12.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.409857 13184 consensus_queue.cc:260] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } }
14:23:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.419266 13180 raft_consensus.cc:493] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.419703 13180 raft_consensus.cc:515] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.421762 13180 leader_election.cc:290] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:12.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.423975 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.424625 11993 raft_consensus.cc:2468] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 0.
14:23:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.424571 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.425197 12134 raft_consensus.cc:2468] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 0.
14:23:12.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.426432 12213 leader_election.cc:304] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:12.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.432507 13180 raft_consensus.cc:2804] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:12.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.432811 13180 raft_consensus.cc:493] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:12.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.433127 13180 raft_consensus.cc:3060] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Advancing to term 1
14:23:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.439254 13197 raft_consensus.cc:493] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.418823 13184 ts_tablet_manager.cc:1434] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
14:23:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.439666 13197 raft_consensus.cc:515] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.441495 13197 leader_election.cc:290] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.442502 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b" is_pre_election: true
14:23:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.443071 12276 raft_consensus.cc:2468] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in term 0.
14:23:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.444274 11927 leader_election.cc:304] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.445814 13197 raft_consensus.cc:2804] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.446168 13197 raft_consensus.cc:493] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.446189 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" is_pre_election: true
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.446492 13197 raft_consensus.cc:3060] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.446787 12134 raft_consensus.cc:2468] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in term 0.
14:23:12.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.449353 13184 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0: Bootstrap starting.
14:23:12.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.454464 13197 raft_consensus.cc:515] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.457139 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:12.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.457463 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8479b7c28d58460a94f7a9353d62fda7" candidate_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b"
14:23:12.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.457664 12134 raft_consensus.cc:3060] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.457988 12276 raft_consensus.cc:3060] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 0 FOLLOWER]: Advancing to term 1
14:23:12.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.464092 12134 raft_consensus.cc:2468] T 8479b7c28d58460a94f7a9353d62fda7 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in term 1.
14:23:12.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.464295 12276 raft_consensus.cc:2468] T 8479b7c28d58460a94f7a9353d62fda7 P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf18c755793a4c3bb04fd7fcb4a3a3c3 in term 1.
14:23:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.465320 11926 leader_election.cc:304] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b2c86b157d47fbbfaa5d11dcd304f0, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.466219 13197 leader_election.cc:290] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.466776 13197 raft_consensus.cc:2804] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election won for term 1
14:23:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.467182 13197 raft_consensus.cc:697] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 LEADER]: Becoming Leader. State: Replica: bf18c755793a4c3bb04fd7fcb4a3a3c3, State: Running, Role: LEADER
14:23:12.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.468225 13197 consensus_queue.cc:237] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.451036 13180 raft_consensus.cc:515] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.479367 11993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3"
14:23:12.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.480101 11993 raft_consensus.cc:3060] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.489444 11993 raft_consensus.cc:2468] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 1.
14:23:12.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.490727 12213 leader_election.cc:304] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3; no voters: 
14:23:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.491907 13194 raft_consensus.cc:2804] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 1 FOLLOWER]: Leader election won for term 1
14:23:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.492463 13194 raft_consensus.cc:697] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [term 1 LEADER]: Becoming Leader. State: Replica: 645f513b6cfd479a9020a5b95e6ce42b, State: Running, Role: LEADER
14:23:12.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.500100 13198 consensus_queue.cc:1048] T e114fea09fd44768885e5a039ff61762 P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.493510 13194 consensus_queue.cc:237] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.518339 13180 leader_election.cc:290] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [CANDIDATE]: Term 1 election: Requested vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 08b2c86b157d47fbbfaa5d11dcd304f0 (127.11.83.130:43593)
14:23:12.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.519161 12134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466db4c4ffe14cf48387c9ef2e2e7bdb" candidate_uuid: "645f513b6cfd479a9020a5b95e6ce42b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0"
14:23:12.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.519806 12134 raft_consensus.cc:3060] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.526753 12135 raft_consensus.cc:3060] T c727d8dcd101499c83395f60403d724d P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.537546 13198 consensus_queue.cc:1048] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.541615 13184 tablet_bootstrap.cc:654] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0: Neither blocks nor log segments found. Creating new log.
14:23:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.570212 13184 tablet_bootstrap.cc:492] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0: No bootstrap required, opened a new log
14:23:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.570611 13184 ts_tablet_manager.cc:1403] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.003s
14:23:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.573089 13184 raft_consensus.cc:359] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.573706 13184 raft_consensus.cc:385] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.574026 13184 raft_consensus.cc:740] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2c86b157d47fbbfaa5d11dcd304f0, State: Initialized, Role: FOLLOWER
14:23:12.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.576094 11800 catalog_manager.cc:5697] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b reported cstate change: term changed from 0 to 1, leader changed from <none> to 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131). New cstate: current_term: 1 leader_uuid: "645f513b6cfd479a9020a5b95e6ce42b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } health_report { overall_health: HEALTHY } } }
14:23:12.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.579214 13184 consensus_queue.cc:260] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.581820 13184 ts_tablet_manager.cc:1434] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
14:23:12.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.588855 11801 catalog_manager.cc:5697] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129). New cstate: current_term: 1 leader_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } health_report { overall_health: UNKNOWN } } }
14:23:12.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.620549 13198 consensus_queue.cc:1048] T c727d8dcd101499c83395f60403d724d P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.635747 12134 raft_consensus.cc:2468] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 645f513b6cfd479a9020a5b95e6ce42b in term 1.
14:23:12.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:12.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.703307 12276 raft_consensus.cc:1275] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 2 FOLLOWER]: Refusing update from remote peer 08b2c86b157d47fbbfaa5d11dcd304f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
14:23:12.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.703670 12276 pending_rounds.cc:85] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Aborting all ops after (but not including) 0
14:23:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.703946 12276 pending_rounds.cc:107] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b: Aborting uncommitted NO_OP operation due to leader change: 1.1
14:23:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.704231 12276 raft_consensus.cc:2889] T 2c42eaec0d824e86a11149430f2d1456 P 645f513b6cfd479a9020a5b95e6ce42b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
14:23:12.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.706137 13202 consensus_queue.cc:1048] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.733858 11994 raft_consensus.cc:1275] T 2c42eaec0d824e86a11149430f2d1456 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 2 FOLLOWER]: Refusing update from remote peer 08b2c86b157d47fbbfaa5d11dcd304f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
14:23:12.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.735735 13213 consensus_queue.cc:1048] T 2c42eaec0d824e86a11149430f2d1456 P 08b2c86b157d47fbbfaa5d11dcd304f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.778 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:12.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:12.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:12.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:12.790 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:12.792 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299997}]
14:23:12.792 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=13), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.83.188:44337, [8ms] Sub RPC GetTableLocations: received response from server master-127.11.83.188:44337: OK, deferred=null) after lookup
14:23:12.794 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:12.795 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:12.813 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:12.817 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xbd0a7746, L:/127.0.0.1:51448 - R:/127.11.83.131:33751] using TOKEN/null
14:23:12.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.825866 13213 raft_consensus.cc:493] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.826350 13213 raft_consensus.cc:515] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 } } peers { permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 } } peers { permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 } }
14:23:12.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.828115 13213 leader_election.cc:290] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf18c755793a4c3bb04fd7fcb4a3a3c3 (127.11.83.129:32843), 645f513b6cfd479a9020a5b95e6ce42b (127.11.83.131:33751)
14:23:12.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.829099 12276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "645f513b6cfd479a9020a5b95e6ce42b" is_pre_election: true
14:23:12.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.829212 11994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e114fea09fd44768885e5a039ff61762" candidate_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" is_pre_election: true
14:23:12.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.830754 12073 leader_election.cc:304] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08b2c86b157d47fbbfaa5d11dcd304f0; no voters: 645f513b6cfd479a9020a5b95e6ce42b, bf18c755793a4c3bb04fd7fcb4a3a3c3
14:23:12.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.831596 13213 raft_consensus.cc:2749] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:23:12.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.833037 12136 raft_consensus.cc:1275] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 1 FOLLOWER]: Refusing update from remote peer 645f513b6cfd479a9020a5b95e6ce42b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:12.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.833134 11994 raft_consensus.cc:1275] T 466db4c4ffe14cf48387c9ef2e2e7bdb P bf18c755793a4c3bb04fd7fcb4a3a3c3 [term 1 FOLLOWER]: Refusing update from remote peer 645f513b6cfd479a9020a5b95e6ce42b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:12.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.834365 13194 consensus_queue.cc:1048] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf18c755793a4c3bb04fd7fcb4a3a3c3" member_type: VOTER last_known_addr { host: "127.11.83.129" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.835042 13180 consensus_queue.cc:1048] T 466db4c4ffe14cf48387c9ef2e2e7bdb P 645f513b6cfd479a9020a5b95e6ce42b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.857542 13197 consensus_queue.cc:1048] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "645f513b6cfd479a9020a5b95e6ce42b" member_type: VOTER last_known_addr { host: "127.11.83.131" port: 33751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.871407 13220 consensus_queue.cc:1048] T 8479b7c28d58460a94f7a9353d62fda7 P bf18c755793a4c3bb04fd7fcb4a3a3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b2c86b157d47fbbfaa5d11dcd304f0" member_type: VOTER last_known_addr { host: "127.11.83.130" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:12.880 [DEBUG - main] (Connection.java:748) [peer bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)] connecting to peer
14:23:12.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:12.896517 12135 raft_consensus.cc:3060] T e114fea09fd44768885e5a039ff61762 P 08b2c86b157d47fbbfaa5d11dcd304f0 [term 0 FOLLOWER]: Advancing to term 1
14:23:12.908 [DEBUG - kudu-nio-4] (Connection.java:757) [peer bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)] Successfully connected to peer
14:23:12.952 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:12.962 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x66a7a604, L:/127.0.0.1:57788 - R:/127.11.83.129:32843] using TOKEN/null
14:23:13.003 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:13.003 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:13.003 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:13.003 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:13.003 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:13.004 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:13.004 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=14), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.83.188:44337, [14ms] Sub RPC GetTableLocations: received response from server master-127.11.83.188:44337: OK, deferred=null) after lookup
14:23:13.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:13.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:13.122 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:13.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.123 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:13.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:13.201 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:13.203 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:13.210 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:13.221 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:13.221 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:13.236 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:13.237 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:13.246 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:13.250 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:13.273 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:13.274 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:13.283 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.293 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.294 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:13.295 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:13.295 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.295 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:13.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.297 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.298 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:13.298 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x05830c04, L:/127.0.0.1:57318 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:13.301 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x19957c73, L:/127.0.0.1:35638 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:13.305 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:13.306 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=102), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [96ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:13.309 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf7c56ee4, L:/127.0.0.1:38218 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:13.315 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:13.320 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:13.333 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.83.190:41547(127.11.83.190:41547)] Successfully connected to peer
14:23:13.343 [DEBUG - main] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:13.345 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.83.188:44337(127.11.83.188:44337)] Successfully connected to peer
14:23:13.346 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.190
14:23:13.366 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.83.189:34071(127.11.83.189:34071)] Successfully connected to peer
14:23:13.369 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.188
14:23:13.371 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.376 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5355887c, L:/127.0.0.1:38588 - R:/127.11.83.190:41547] using SASL/PLAIN
14:23:13.382 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.384 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.189
14:23:13.388 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x76e6a1ef, L:/127.0.0.1:59300 - R:/127.11.83.188:44337] using SASL/PLAIN
14:23:13.391 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:13.391 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=83), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: OK, deferred=null) after lookup
14:23:13.394 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:13.397 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:13.399 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x497346a4, L:/127.0.0.1:51452 - R:/127.11.83.189:34071] using SASL/PLAIN
14:23:13.402 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:13.402 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:13.402 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:13.402 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:13.402 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:13.403 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.406899 12454 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35638:
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:23:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:13.411777 12454 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:23:13.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:13.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.562673 12708 tablet_service.cc:1511] Processing CreateTablet for tablet 8220d165661e4bb9b639b812c1b0bed0 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.566011 12708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8220d165661e4bb9b639b812c1b0bed0. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.566316 12709 tablet_service.cc:1511] Processing CreateTablet for tablet ff4eb90013ed4767bc44a96a380c1718 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.567410 12709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4eb90013ed4767bc44a96a380c1718. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.570667 12706 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7dbab9aec46b79563c2133a1d4e41 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.572024 12706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7dbab9aec46b79563c2133a1d4e41. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.576922 12707 tablet_service.cc:1511] Processing CreateTablet for tablet 6516b49b7b42485aa6635e2668d6639f (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.579229 12707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6516b49b7b42485aa6635e2668d6639f. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.582623 12710 tablet_service.cc:1511] Processing CreateTablet for tablet f1ef2780a92448bfb22fa93938bd9281 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.587075 12710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ef2780a92448bfb22fa93938bd9281. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.638105 13069 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7dbab9aec46b79563c2133a1d4e41 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.638087 13070 tablet_service.cc:1511] Processing CreateTablet for tablet 6516b49b7b42485aa6635e2668d6639f (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.640823 13071 tablet_service.cc:1511] Processing CreateTablet for tablet 8220d165661e4bb9b639b812c1b0bed0 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.641569 13069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7dbab9aec46b79563c2133a1d4e41. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.643181 13070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6516b49b7b42485aa6635e2668d6639f. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.643028 13072 tablet_service.cc:1511] Processing CreateTablet for tablet ff4eb90013ed4767bc44a96a380c1718 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.644032 13071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8220d165661e4bb9b639b812c1b0bed0. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.645869 13072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4eb90013ed4767bc44a96a380c1718. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.647564 13073 tablet_service.cc:1511] Processing CreateTablet for tablet f1ef2780a92448bfb22fa93938bd9281 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.649161 13073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ef2780a92448bfb22fa93938bd9281. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.659678 12875 tablet_service.cc:1511] Processing CreateTablet for tablet ff4eb90013ed4767bc44a96a380c1718 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.660770 12872 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7dbab9aec46b79563c2133a1d4e41 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.660023 12876 tablet_service.cc:1511] Processing CreateTablet for tablet f1ef2780a92448bfb22fa93938bd9281 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.663115 12873 tablet_service.cc:1511] Processing CreateTablet for tablet 6516b49b7b42485aa6635e2668d6639f (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.665076 12874 tablet_service.cc:1511] Processing CreateTablet for tablet 8220d165661e4bb9b639b812c1b0bed0 (DEFAULT_TABLE table=replication_test_table [id=16f4549a5d964ae882a20198bb0b6565]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
14:23:13.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.661866 12875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4eb90013ed4767bc44a96a380c1718. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.667459 12876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ef2780a92448bfb22fa93938bd9281. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.668067 12872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7dbab9aec46b79563c2133a1d4e41. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:13.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.674306 12873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6516b49b7b42485aa6635e2668d6639f. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.676003 12874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8220d165661e4bb9b639b812c1b0bed0. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:13.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.707943 13281 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Bootstrap starting.
14:23:13.712 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:13.718 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:13.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.719 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:13.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.720 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.720 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.720 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:13.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.729761 13281 tablet_bootstrap.cc:654] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Neither blocks nor log segments found. Creating new log.
14:23:13.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.739020 13281 log.cc:826] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Log is configured to *not* fsync() on all Append() calls
14:23:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.756700 13284 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: Bootstrap starting.
14:23:13.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.757755 13281 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: No bootstrap required, opened a new log
14:23:13.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.758495 13281 ts_tablet_manager.cc:1403] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.000s
14:23:13.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.769116 13284 tablet_bootstrap.cc:654] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: Neither blocks nor log segments found. Creating new log.
14:23:13.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.771224 13284 log.cc:826] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: Log is configured to *not* fsync() on all Append() calls
14:23:13.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.782018 13284 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: No bootstrap required, opened a new log
14:23:13.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.782455 13284 ts_tablet_manager.cc:1403] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.011s
14:23:13.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.810626 13284 raft_consensus.cc:359] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.811477 13284 raft_consensus.cc:385] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:13.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.811767 13284 raft_consensus.cc:740] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Initialized, Role: FOLLOWER
14:23:13.812 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:13.813 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:13.813 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:13.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:13.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.814 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.812711 13284 consensus_queue.cc:260] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.814 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.814 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:13.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:13.815 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.810629 13286 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Bootstrap starting.
14:23:13.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.839212 13281 raft_consensus.cc:359] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.840 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:13.841 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:13.841 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:13.842 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.842 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.842 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:13.843 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:13.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:13.844 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.853209 13286 tablet_bootstrap.cc:654] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Neither blocks nor log segments found. Creating new log.
14:23:13.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.856081 13286 log.cc:826] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Log is configured to *not* fsync() on all Append() calls
14:23:13.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.859680 13281 raft_consensus.cc:385] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.860067 13284 ts_tablet_manager.cc:1434] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent starting tablet: real 0.077s	user 0.034s	sys 0.040s
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.860040 13281 raft_consensus.cc:740] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Initialized, Role: FOLLOWER
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.861011 13284 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: Bootstrap starting.
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.860949 13281 consensus_queue.cc:260] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.867805 13284 tablet_bootstrap.cc:654] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: Neither blocks nor log segments found. Creating new log.
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.870163 13286 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: No bootstrap required, opened a new log
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.870658 13286 ts_tablet_manager.cc:1403] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.000s
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.878873 13281 ts_tablet_manager.cc:1434] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent starting tablet: real 0.120s	user 0.037s	sys 0.000s
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.879843 13281 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Bootstrap starting.
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.881248 13284 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: No bootstrap required, opened a new log
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.881606 13284 ts_tablet_manager.cc:1403] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.010s
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.884377 13284 raft_consensus.cc:359] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.885017 13284 raft_consensus.cc:385] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.885288 13284 raft_consensus.cc:740] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Initialized, Role: FOLLOWER
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.886063 13284 consensus_queue.cc:260] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.887951 13284 ts_tablet_manager.cc:1434] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
14:23:13.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.906134 13284 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97: Bootstrap starting.
14:23:13.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.912427 13284 tablet_bootstrap.cc:654] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97: Neither blocks nor log segments found. Creating new log.
14:23:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.933004 13284 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97: No bootstrap required, opened a new log
14:23:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.933635 13281 tablet_bootstrap.cc:654] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Neither blocks nor log segments found. Creating new log.
14:23:13.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.933637 13284 ts_tablet_manager.cc:1403] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.013s
14:23:13.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.948387 13284 raft_consensus.cc:359] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:13.955380 12786 tablet.cc:2404] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:13.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.956035 13281 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9: No bootstrap required, opened a new log
14:23:13.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.956436 13281 ts_tablet_manager.cc:1403] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.005s
14:23:13.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.958927 13281 raft_consensus.cc:359] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:13.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.959533 13281 raft_consensus.cc:385] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:13.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:13.960824 13145 tablet.cc:2404] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:13.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.963776 13284 raft_consensus.cc:385] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:13.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.964231 13284 raft_consensus.cc:740] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Initialized, Role: FOLLOWER
14:23:13.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.965245 13284 consensus_queue.cc:260] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:13.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.959784 13281 raft_consensus.cc:740] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Initialized, Role: FOLLOWER
14:23:13.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.973637 13281 consensus_queue.cc:260] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:13.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.979770 13281 ts_tablet_manager.cc:1434] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
14:23:13.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.984067 13281 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Bootstrap starting.
14:23:13.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.984516 13284 ts_tablet_manager.cc:1434] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
14:23:13.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.987457 13284 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97: Bootstrap starting.
14:23:14.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.004184 13281 tablet_bootstrap.cc:654] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Neither blocks nor log segments found. Creating new log.
14:23:14.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.004114 13284 tablet_bootstrap.cc:654] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97: Neither blocks nor log segments found. Creating new log.
14:23:14.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:13.997639 13286 raft_consensus.cc:359] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.014367 13289 raft_consensus.cc:493] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.014638 13286 raft_consensus.cc:385] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.014942 13286 raft_consensus.cc:740] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841c04c70cf49bba29d6e57b6ea4c6e, State: Initialized, Role: FOLLOWER
14:23:14.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.015973 13286 consensus_queue.cc:260] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.014946 13289 raft_consensus.cc:515] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.022197 13289 leader_election.cc:290] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867), 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:14.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.047053 13286 ts_tablet_manager.cc:1434] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent starting tablet: real 0.176s	user 0.032s	sys 0.004s
14:23:14.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.048455 13286 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e: Bootstrap starting.
14:23:14.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.064220 12944 tablet.cc:2404] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:14.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.074683 13093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" is_pre_election: true
14:23:14.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.075599 13093 raft_consensus.cc:2468] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2348a0f6cd84dffaa4fa04af9eaf0b9 in term 0.
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.077775 12896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.078364 12666 leader_election.cc:304] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: 
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.079267 13289 raft_consensus.cc:2804] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.079630 13289 raft_consensus.cc:493] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.079960 13289 raft_consensus.cc:3060] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.079993 12663 leader_election.cc:343] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.083453 13286 tablet_bootstrap.cc:654] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e: Neither blocks nor log segments found. Creating new log.
14:23:14.085 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:14.086 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.086 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.086 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.087 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:14.087 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:14.088 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.088 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.089 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:14.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.087178 13289 raft_consensus.cc:515] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.088914 13289 leader_election.cc:290] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 election: Requested vote from peers b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867), 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:14.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.089571 12896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:14.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.091008 12663 leader_election.cc:343] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.092252 13093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43408dde659b44f5a0f27fdd2a5a1f97"
14:23:14.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.092716 13093 raft_consensus.cc:3060] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.101217 13093 raft_consensus.cc:2468] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2348a0f6cd84dffaa4fa04af9eaf0b9 in term 1.
14:23:14.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.102389 12666 leader_election.cc:304] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: b841c04c70cf49bba29d6e57b6ea4c6e
14:23:14.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.103071 13289 raft_consensus.cc:2804] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Leader election won for term 1
14:23:14.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.105387 13284 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97: No bootstrap required, opened a new log
14:23:14.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.105773 13284 ts_tablet_manager.cc:1403] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.016s
14:23:14.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.110821 13284 raft_consensus.cc:359] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.111414 13284 raft_consensus.cc:385] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.111677 13284 raft_consensus.cc:740] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Initialized, Role: FOLLOWER
14:23:14.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.112267 13284 consensus_queue.cc:260] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.116549 13286 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e: No bootstrap required, opened a new log
14:23:14.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.117079 13286 ts_tablet_manager.cc:1403] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.007s
14:23:14.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.120388 13286 raft_consensus.cc:359] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.121027 13286 raft_consensus.cc:385] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.121258 13286 raft_consensus.cc:740] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841c04c70cf49bba29d6e57b6ea4c6e, State: Initialized, Role: FOLLOWER
14:23:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.121783 13286 consensus_queue.cc:260] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.123765 13286 ts_tablet_manager.cc:1434] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
14:23:14.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.124620 13286 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e: Bootstrap starting.
14:23:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.132946 13286 tablet_bootstrap.cc:654] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e: Neither blocks nor log segments found. Creating new log.
14:23:14.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.134980 13289 raft_consensus.cc:697] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 LEADER]: Becoming Leader. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Running, Role: LEADER
14:23:14.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.136979 13289 consensus_queue.cc:237] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.148759 13281 tablet_bootstrap.cc:492] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9: No bootstrap required, opened a new log
14:23:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.149189 13281 ts_tablet_manager.cc:1403] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent bootstrapping tablet: real 0.165s	user 0.022s	sys 0.041s
14:23:14.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.151572 13286 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e: No bootstrap required, opened a new log
14:23:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.151886 13281 raft_consensus.cc:359] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.152549 13281 raft_consensus.cc:385] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.152944 13281 raft_consensus.cc:740] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Initialized, Role: FOLLOWER
14:23:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.153637 13286 ts_tablet_manager.cc:1403] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
14:23:14.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.153690 13281 consensus_queue.cc:260] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.156038 13281 ts_tablet_manager.cc:1434] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
14:23:14.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.156889 13281 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Bootstrap starting.
14:23:14.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.162284 13284 ts_tablet_manager.cc:1434] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.002s
14:23:14.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.163252 13284 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97: Bootstrap starting.
14:23:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.170176 13284 tablet_bootstrap.cc:654] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97: Neither blocks nor log segments found. Creating new log.
14:23:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.172726 13286 raft_consensus.cc:359] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.175 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:14.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.177980 13286 raft_consensus.cc:385] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.178275 13286 raft_consensus.cc:740] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841c04c70cf49bba29d6e57b6ea4c6e, State: Initialized, Role: FOLLOWER
14:23:14.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.179013 13286 consensus_queue.cc:260] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.181439 13284 tablet_bootstrap.cc:492] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97: No bootstrap required, opened a new log
14:23:14.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.181584 13286 ts_tablet_manager.cc:1434] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
14:23:14.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.181787 13284 ts_tablet_manager.cc:1403] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
14:23:14.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.182833 13286 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e: Bootstrap starting.
14:23:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.185491 13281 tablet_bootstrap.cc:654] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Neither blocks nor log segments found. Creating new log.
14:23:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.184414 13284 raft_consensus.cc:359] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.187495 13284 raft_consensus.cc:385] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.187773 13284 raft_consensus.cc:740] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Initialized, Role: FOLLOWER
14:23:14.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.188364 13284 consensus_queue.cc:260] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.190438 13284 ts_tablet_manager.cc:1434] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
14:23:14.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.206038 12454 catalog_manager.cc:5697] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1). New cstate: current_term: 1 leader_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } health_report { overall_health: UNKNOWN } } }
14:23:14.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.217927 13281 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9: No bootstrap required, opened a new log
14:23:14.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.218346 13281 ts_tablet_manager.cc:1403] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.008s
14:23:14.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.222313 13281 raft_consensus.cc:359] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.224743 13281 raft_consensus.cc:385] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.225018 13281 raft_consensus.cc:740] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Initialized, Role: FOLLOWER
14:23:14.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.225575 13281 consensus_queue.cc:260] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.231669 13281 ts_tablet_manager.cc:1434] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
14:23:14.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.245502 13287 raft_consensus.cc:493] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.246017 13287 raft_consensus.cc:515] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.268064 13287 leader_election.cc:290] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.268585 13287 raft_consensus.cc:493] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.268951 13287 raft_consensus.cc:515] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.272492 13287 leader_election.cc:290] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.274989 13281 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Bootstrap starting.
14:23:14.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.286410 13286 tablet_bootstrap.cc:654] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e: Neither blocks nor log segments found. Creating new log.
14:23:14.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.292979 13307 raft_consensus.cc:493] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.293879 13307 raft_consensus.cc:515] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.303383 13307 leader_election.cc:290] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.310482 12896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.311177 12896 raft_consensus.cc:2468] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 0.
14:23:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.311383 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4eb90013ed4767bc44a96a380c1718" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.312289 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8220d165661e4bb9b639b812c1b0bed0" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.312887 12895 raft_consensus.cc:2468] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 0.
14:23:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.313786 13026 leader_election.cc:304] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 
14:23:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.314762 13026 leader_election.cc:343] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.315814 13026 leader_election.cc:304] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 
14:23:14.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.316510 13287 raft_consensus.cc:2804] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:14.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.316826 13287 raft_consensus.cc:493] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:14.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.317092 13287 raft_consensus.cc:3060] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.323678 13289 raft_consensus.cc:493] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.323936 13287 raft_consensus.cc:515] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.324184 13289 raft_consensus.cc:515] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.326225 13289 leader_election.cc:290] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.327142 13093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" is_pre_election: true
14:23:14.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.327306 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:14.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.327762 12894 raft_consensus.cc:3060] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Advancing to term 1
14:23:14.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.327893 13093 raft_consensus.cc:2393] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2348a0f6cd84dffaa4fa04af9eaf0b9 in current term 1: Already voted for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in this term.
14:23:14.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.328787 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.331456 12666 leader_election.cc:304] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e
14:23:14.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.332075 13289 raft_consensus.cc:3060] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.340 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.334262 12894 raft_consensus.cc:2468] T f1ef2780a92448bfb22fa93938bd9281 P b841c04c70cf49bba29d6e57b6ea4c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.335217 13026 leader_election.cc:304] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 
14:23:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.337328 13287 leader_election.cc:290] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Requested vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.337769 13287 raft_consensus.cc:2804] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.338037 13287 raft_consensus.cc:493] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.338291 13287 raft_consensus.cc:3060] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.339947 13289 raft_consensus.cc:2749] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:23:14.341 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:14.341 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:14.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.343 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:14.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.344126 13307 raft_consensus.cc:2804] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader election won for term 1
14:23:14.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.341758 13295 raft_consensus.cc:493] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.345161 13307 raft_consensus.cc:697] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 LEADER]: Becoming Leader. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Running, Role: LEADER
14:23:14.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.344857 13295 raft_consensus.cc:515] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.347391 13307 consensus_queue.cc:237] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } }
14:23:14.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.350406 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4eb90013ed4767bc44a96a380c1718" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.351163 12728 raft_consensus.cc:2468] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 0.
14:23:14.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.351724 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:14.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.351181 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8220d165661e4bb9b639b812c1b0bed0" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.353942 13295 leader_election.cc:290] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:14.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.355800 13028 leader_election.cc:304] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: b841c04c70cf49bba29d6e57b6ea4c6e
14:23:14.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.360734 13314 raft_consensus.cc:2804] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:14.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.361083 13314 raft_consensus.cc:493] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:14.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.361397 13314 raft_consensus.cc:3060] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.366252 13317 raft_consensus.cc:493] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.366740 13317 raft_consensus.cc:515] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.349449 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ef2780a92448bfb22fa93938bd9281" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.369608 13281 tablet_bootstrap.cc:654] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Neither blocks nor log segments found. Creating new log.
14:23:14.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.370105 12727 raft_consensus.cc:2468] T f1ef2780a92448bfb22fa93938bd9281 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.379153 12453 catalog_manager.cc:5697] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3). New cstate: current_term: 1 leader_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } health_report { overall_health: UNKNOWN } } }
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.382596 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" is_pre_election: true
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.383081 12894 raft_consensus.cc:2468] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 0.
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.384130 13026 leader_election.cc:304] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.384308 13317 leader_election.cc:290] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.385524 13317 raft_consensus.cc:2804] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:14.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.385788 13317 raft_consensus.cc:493] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:14.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.386085 13317 raft_consensus.cc:3060] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.398598 13287 raft_consensus.cc:515] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.386852 13314 raft_consensus.cc:515] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.405620 13314 leader_election.cc:290] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Requested vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.407328 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4eb90013ed4767bc44a96a380c1718" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.407989 13287 leader_election.cc:290] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Requested vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.409104 13026 leader_election.cc:343] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.411949 13317 raft_consensus.cc:515] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.412400 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8220d165661e4bb9b639b812c1b0bed0" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.412885 12894 raft_consensus.cc:3060] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Advancing to term 1
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.414448 13317 leader_election.cc:290] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Requested vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), b841c04c70cf49bba29d6e57b6ea4c6e (127.12.11.2:40867)
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.414667 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e"
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.415210 12895 raft_consensus.cc:3060] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Advancing to term 1
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.416683 13028 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.11.1:39911, user_credentials={real_user=slave}} blocked reactor thread for 61087.5us
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.417291 13028 leader_election.cc:343] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.418273 13093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" is_pre_election: true
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.418968 13093 raft_consensus.cc:2393] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b841c04c70cf49bba29d6e57b6ea4c6e in current term 1: Already voted for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in this term.
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.420855 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.421394 12727 raft_consensus.cc:2468] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 0.
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.422245 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8220d165661e4bb9b639b812c1b0bed0" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.423626 13286 tablet_bootstrap.cc:492] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e: No bootstrap required, opened a new log
14:23:14.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.424012 13286 ts_tablet_manager.cc:1403] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.001s
14:23:14.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.428092 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.428614 12730 raft_consensus.cc:2468] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b841c04c70cf49bba29d6e57b6ea4c6e in term 0.
14:23:14.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.436249 12730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4eb90013ed4767bc44a96a380c1718" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:14.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.436808 12730 raft_consensus.cc:3060] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.440629 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7dbab9aec46b79563c2133a1d4e41" candidate_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9"
14:23:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:14.441180 13028 leader_election.cc:343] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911): Illegal state: must be running to vote when last-logged opid is not known
14:23:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.441239 12727 raft_consensus.cc:3060] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.442066 12831 leader_election.cc:304] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b841c04c70cf49bba29d6e57b6ea4c6e, e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: 
14:23:14.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.447209 12895 raft_consensus.cc:2468] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.450487 13295 raft_consensus.cc:2764] T 5ba7dbab9aec46b79563c2133a1d4e41 P b841c04c70cf49bba29d6e57b6ea4c6e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
14:23:14.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.451267 13026 leader_election.cc:304] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 
14:23:14.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.454294 13316 raft_consensus.cc:2804] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader election won for term 1
14:23:14.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.454766 13316 raft_consensus.cc:697] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 LEADER]: Becoming Leader. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Running, Role: LEADER
14:23:14.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.456262 12730 raft_consensus.cc:2468] T ff4eb90013ed4767bc44a96a380c1718 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.457367 13028 leader_election.cc:304] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, e2348a0f6cd84dffaa4fa04af9eaf0b9; no voters: b841c04c70cf49bba29d6e57b6ea4c6e
14:23:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.458050 13317 raft_consensus.cc:2804] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader election won for term 1
14:23:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.458449 13317 raft_consensus.cc:697] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 LEADER]: Becoming Leader. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Running, Role: LEADER
14:23:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.455583 13316 consensus_queue.cc:237] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.459148 13317 consensus_queue.cc:237] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.461480 12894 raft_consensus.cc:2468] T 8220d165661e4bb9b639b812c1b0bed0 P b841c04c70cf49bba29d6e57b6ea4c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.465272 13026 leader_election.cc:304] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43408dde659b44f5a0f27fdd2a5a1f97, b841c04c70cf49bba29d6e57b6ea4c6e; no voters: e2348a0f6cd84dffaa4fa04af9eaf0b9
14:23:14.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.465647 13281 tablet_bootstrap.cc:492] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9: No bootstrap required, opened a new log
14:23:14.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.465971 13287 raft_consensus.cc:2804] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader election won for term 1
14:23:14.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.466393 13281 ts_tablet_manager.cc:1403] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.003s
14:23:14.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.466414 13287 raft_consensus.cc:697] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 LEADER]: Becoming Leader. State: Replica: 43408dde659b44f5a0f27fdd2a5a1f97, State: Running, Role: LEADER
14:23:14.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.471848 12727 raft_consensus.cc:2468] T 5ba7dbab9aec46b79563c2133a1d4e41 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43408dde659b44f5a0f27fdd2a5a1f97 in term 1.
14:23:14.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.472815 13281 raft_consensus.cc:359] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.473531 13281 raft_consensus.cc:385] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.473809 13281 raft_consensus.cc:740] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2348a0f6cd84dffaa4fa04af9eaf0b9, State: Initialized, Role: FOLLOWER
14:23:14.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.474519 13281 consensus_queue.cc:260] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.475922 13286 raft_consensus.cc:359] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.467327 13287 consensus_queue.cc:237] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.477741 13286 raft_consensus.cc:385] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.478121 13286 raft_consensus.cc:740] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841c04c70cf49bba29d6e57b6ea4c6e, State: Initialized, Role: FOLLOWER
14:23:14.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.478964 13286 consensus_queue.cc:260] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.484850 13281 ts_tablet_manager.cc:1434] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
14:23:14.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.485348 13295 raft_consensus.cc:493] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:14.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.485716 13295 raft_consensus.cc:515] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.487458 13295 leader_election.cc:290] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911), 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3:46811)
14:23:14.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.488538 13286 ts_tablet_manager.cc:1434] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.004s
14:23:14.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.489751 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" is_pre_election: true
14:23:14.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.492841 13286 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e: Bootstrap starting.
14:23:14.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.502629 13286 tablet_bootstrap.cc:654] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e: Neither blocks nor log segments found. Creating new log.
14:23:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.508726 13093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6516b49b7b42485aa6635e2668d6639f" candidate_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" is_pre_election: true
14:23:14.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.509644 13093 raft_consensus.cc:2393] T 6516b49b7b42485aa6635e2668d6639f P 43408dde659b44f5a0f27fdd2a5a1f97 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b841c04c70cf49bba29d6e57b6ea4c6e in current term 1: Already voted for candidate e2348a0f6cd84dffaa4fa04af9eaf0b9 in this term.
14:23:14.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.535286 12832 leader_election.cc:304] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b841c04c70cf49bba29d6e57b6ea4c6e; no voters: 43408dde659b44f5a0f27fdd2a5a1f97, e2348a0f6cd84dffaa4fa04af9eaf0b9
14:23:14.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.540472 13295 raft_consensus.cc:3060] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Advancing to term 1
14:23:14.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.552986 13286 tablet_bootstrap.cc:492] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e: No bootstrap required, opened a new log
14:23:14.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.553272 13295 raft_consensus.cc:2749] T 6516b49b7b42485aa6635e2668d6639f P b841c04c70cf49bba29d6e57b6ea4c6e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:23:14.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.553496 13286 ts_tablet_manager.cc:1403] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.027s
14:23:14.556 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:14.556 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:14.557 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:14.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:14.560 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.560 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:14.561 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.561 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.561 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.556300 13286 raft_consensus.cc:359] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.556921 13286 raft_consensus.cc:385] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.557194 13286 raft_consensus.cc:740] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841c04c70cf49bba29d6e57b6ea4c6e, State: Initialized, Role: FOLLOWER
14:23:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.557796 13286 consensus_queue.cc:260] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } }
14:23:14.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.559945 13286 ts_tablet_manager.cc:1434] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
14:23:14.561 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:14.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.573498 12452 catalog_manager.cc:5697] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3). New cstate: current_term: 1 leader_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } health_report { overall_health: HEALTHY } } }
14:23:14.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.577258 12452 catalog_manager.cc:5697] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3). New cstate: current_term: 1 leader_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } health_report { overall_health: HEALTHY } } }
14:23:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.580883 12452 catalog_manager.cc:5697] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43408dde659b44f5a0f27fdd2a5a1f97 (127.12.11.3). New cstate: current_term: 1 leader_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 } health_report { overall_health: HEALTHY } } }
14:23:14.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:14.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.675163 13289 consensus_queue.cc:1048] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.691959 13330 consensus_queue.cc:1048] T 6516b49b7b42485aa6635e2668d6639f P e2348a0f6cd84dffaa4fa04af9eaf0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43408dde659b44f5a0f27fdd2a5a1f97" member_type: VOTER last_known_addr { host: "127.12.11.3" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.805740 13287 consensus_queue.cc:1048] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.820777 13314 consensus_queue.cc:1048] T f1ef2780a92448bfb22fa93938bd9281 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.878383 13287 consensus_queue.cc:1048] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.878696 13314 consensus_queue.cc:1048] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.891501 12727 raft_consensus.cc:3060] T 8220d165661e4bb9b639b812c1b0bed0 P e2348a0f6cd84dffaa4fa04af9eaf0b9 [term 0 FOLLOWER]: Advancing to term 1
14:23:14.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.900652 13287 consensus_queue.cc:1048] T 8220d165661e4bb9b639b812c1b0bed0 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.910666 13287 consensus_queue.cc:1048] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.920037 13287 consensus_queue.cc:1048] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2348a0f6cd84dffaa4fa04af9eaf0b9" member_type: VOTER last_known_addr { host: "127.12.11.1" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:14.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.951272 12894 raft_consensus.cc:3060] T ff4eb90013ed4767bc44a96a380c1718 P b841c04c70cf49bba29d6e57b6ea4c6e [term 0 FOLLOWER]: Advancing to term 1
14:23:14.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:14.964329 13314 consensus_queue.cc:1048] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841c04c70cf49bba29d6e57b6ea4c6e" member_type: VOTER last_known_addr { host: "127.12.11.2" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:15.021 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:15.022 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:15.022 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:15.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.026 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.026 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.027 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.027 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:15.033 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state READY
14:23:15.033 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state READY
14:23:15.033 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state READY
14:23:15.034 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:15.034 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.83.189:34071(127.11.83.189:34071)] handling channelInactive
14:23:15.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state READY due to: connection closed
14:23:15.034 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.83.188:44337(127.11.83.188:44337)] handling channelInactive
14:23:15.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state READY due to: connection closed
14:23:15.035 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:23:15.036 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
14:23:15.042 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state READY
14:23:15.042 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.83.190:41547(127.11.83.190:41547)] handling channelInactive
14:23:15.042 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state READY
14:23:15.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state READY due to: connection closed
14:23:15.042 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state READY
14:23:15.042 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:23:15.043 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:15.043 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:15.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:15.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:15.043 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:15.044 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
14:23:15.044 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:23:15.050 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:15.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:15.051 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:15.052 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:15.052 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:23:15.052 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:23:15.052 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:15.052 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:15.053 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:23:15.059 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:23:15.059 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:23:15.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:15.192 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:15.193 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:15.193 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:15.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:15.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:15.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:15.195 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:15.195 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:15.195 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:15.197 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:15.197 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:15.197 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:15.197 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:15.267 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:23:15.326 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:23:15.326 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:23:15.326 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:23:15.337 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:23:15.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:15.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:15.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:15.916 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:15.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:15.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:15.920 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:15.920 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.020 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:16.021 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:16.021 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:16.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.021 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.022 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.022 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.022 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.022 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.022 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.022 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.022 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.033 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:23:16.120 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:16.121 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:16.121 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:16.121 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.121 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.121 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.121 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.121 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.122 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.122 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.122 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.121 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.171 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:16.174 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:16.175 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:16.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.175 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:16.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.176 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.176 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.176 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.180 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:23:16.192 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:23:16.239 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:23:16.252 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:23:16.270 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:23:16.283 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:23:16.284 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:23:16.284 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:23:16.284 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:23:16.285 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:23:16.285 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:23:16.285 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:23:16.285 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:23:16.285 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:23:16.286 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:23:16.287 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:23:16.287 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:23:16.287 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:23:16.287 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:23:16.287 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:23:16.287 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:23:16.287 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:23:16.287 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:23:16.287 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:23:16.288 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:23:16.288 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:23:16.288 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:23:16.289 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:23:16.289 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:23:16.289 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_90e42c0f1b89c5956150f073d70a0476/blobStorage
14:23:16.289 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:39907 - max concurrent requests: 50 - max backlog: 1000
14:23:16.290 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_90e42c0f1b89c5956150f073d70a0476/blobStorage
14:23:16.291 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_90e42c0f1b89c5956150f073d70a0476/blobStorage
14:23:16.291 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:23:16.292 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 93468478-99eb-4785-93a0-96daa5eb43cb
14:23:16.293 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
14:23:16.294 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-d8d644c9-ad39-49a1-b1bc-302865f51660
14:23:16.296 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-35d97fcc-787c-41f4-a514-479ecfd112d1
14:23:16.356 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:23:16.356 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:23:16.356 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:23:16.356 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:23:16.357 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:23:16.359 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_4 .
14:23:16.364 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
14:23:16.364 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-1510645f-86ee-4ee9-85b1-667f4637f185
14:23:16.365 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:23:16.365 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:23:16.373 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:23:16.373 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:23:16.378 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:33607
14:23:16.378 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:23:16.379 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:33607 was granted leadership with leaderSessionID=4ce101e2-87b4-4ecd-9a14-50248d5ad4cb
14:23:16.379 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:33607 , session=4ce101e2-87b4-4ecd-9a14-50248d5ad4cb
14:23:16.380 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:23:16.381 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:23:16.381 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:23:16.381 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id fe65c747-a375-4e90-8449-87d109f91e57. Creating new DispatcherLeaderProcess.
14:23:16.381 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:23:16.382 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:23:16.383 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:23:16.383 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:23:16.386 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_5 .
14:23:16.386 [INFO - pool-49-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 31556e13-d95e-4300-ae19-9a41c247d59b.
14:23:16.392 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_5 , session=fe65c747-a375-4e90-8449-87d109f91e57
14:23:16.394 [INFO - pool-49-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_6 .
14:23:16.412 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
14:23:16.419 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:23:16.419 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:23:16.419 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:23:16.419 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:23:16.420 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_6 , session=31556e13-d95e-4300-ae19-9a41c247d59b
14:23:16.426 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(ae199a41c247d59b31556e13d95e4300).
14:23:16.430 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:23:16.435 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1080) Registering TaskManager with ResourceID 93468478-99eb-4785-93a0-96daa5eb43cb (pekko://flink/user/rpc/taskmanager_4) at ResourceManager
14:23:16.436 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_6 under registration id 65515b4e553cbcb47ae09013eac0c21f.
14:23:16.437 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor 93468478-99eb-4785-93a0-96daa5eb43cb under 65515b4e553cbcb47ae09013eac0c21f at the slot manager.
14:23:16.437 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.438 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.438 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-eb69507117e6ffaf90d8bea22e591f35'.
14:23:16.438 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job eb69507117e6ffaf90d8bea22e591f35 was granted leadership with leader id 8078b150-52ca-4294-8f28-2bd60b87bb2b. Creating new JobMasterServiceProcess.
14:23:16.443 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_7 .
14:23:16.446 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.447 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.447 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 7912f532f84f26a1b5a55178e2daf261 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.447 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.447 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:23:16.448 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:23:16.448 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a1b4b65
14:23:16.448 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:16.448 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:16.450 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:23:16.450 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@34da0cdb for Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35).
14:23:16.451 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_7 , session=8078b150-52ca-4294-8f28-2bd60b87bb2b
14:23:16.451 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (eb69507117e6ffaf90d8bea22e591f35) under job master id 8f282bd60b87bb2b8078b15052ca4294.
14:23:16.452 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:23:16.454 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.454 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:23:16.454 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state CREATED to RUNNING.
14:23:16.458 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:23:16.458 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:16.459 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:23:16.459 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:23:16.459 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:16.459 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:23:16.460 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(ae199a41c247d59b31556e13d95e4300)
14:23:16.461 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:23:16.462 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 8f282bd60b87bb2b8078b15052ca4294@pekko://flink/user/rpc/jobmanager_7 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.464 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.83.190:41547(127.11.83.190:41547)] Successfully connected to peer
14:23:16.467 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:16.468 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager 8f282bd60b87bb2b8078b15052ca4294@pekko://flink/user/rpc/jobmanager_7 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.469 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.190
14:23:16.469 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.83.189:34071(127.11.83.189:34071)] Successfully connected to peer
14:23:16.470 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: ae199a41c247d59b31556e13d95e4300.
14:23:16.471 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:23:16.474 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.83.188:44337(127.11.83.188:44337)] Successfully connected to peer
14:23:16.482 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.487 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.189
14:23:16.487 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.188
14:23:16.491 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5b02a0b8, L:/127.0.0.1:38596 - R:/127.11.83.190:41547] using SASL/PLAIN
14:23:16.496 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:16.497 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:16.498 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.503 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x179060aa, L:/127.0.0.1:51460 - R:/127.11.83.189:34071] using SASL/PLAIN
14:23:16.505 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.507 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job eb69507117e6ffaf90d8bea22e591f35
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 93468478-99eb-4785-93a0-96daa5eb43cb
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:23:16.508 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a39e5fcb8c2557072005ea690bf35b6c from 93468478-99eb-4785-93a0-96daa5eb43cb for job eb69507117e6ffaf90d8bea22e591f35 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.508 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 869b6a91e486470c39aab2d9a4839c92 from 93468478-99eb-4785-93a0-96daa5eb43cb for job eb69507117e6ffaf90d8bea22e591f35 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.509 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 3a331bef465918e8cbe675a7c5e83a3b from 93468478-99eb-4785-93a0-96daa5eb43cb for job eb69507117e6ffaf90d8bea22e591f35 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.509 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4dfbdde7, L:/127.0.0.1:59304 - R:/127.11.83.188:44337] using SASL/PLAIN
14:23:16.509 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1f10924a53a30da094cc2390f240981f from 93468478-99eb-4785-93a0-96daa5eb43cb for job eb69507117e6ffaf90d8bea22e591f35 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.509 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request a39e5fcb8c2557072005ea690bf35b6c for job eb69507117e6ffaf90d8bea22e591f35 from resource manager with leader id ae199a41c247d59b31556e13d95e4300.
14:23:16.512 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for a39e5fcb8c2557072005ea690bf35b6c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.514 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.514 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: OK, [55ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: OK, [55ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: OK, deferred=null) after lookup
14:23:16.521 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:16.530 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:16.531 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:16.531 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:16.532 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:16.539 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:16.541 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:16.541 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:16.548 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:16.554 [DEBUG - main] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:16.555 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:16.558 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job eb69507117e6ffaf90d8bea22e591f35 for job leader monitoring.
14:23:16.558 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 869b6a91e486470c39aab2d9a4839c92 for job eb69507117e6ffaf90d8bea22e591f35 from resource manager with leader id ae199a41c247d59b31556e13d95e4300.
14:23:16.558 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 869b6a91e486470c39aab2d9a4839c92 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.559 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 3a331bef465918e8cbe675a7c5e83a3b for job eb69507117e6ffaf90d8bea22e591f35 from resource manager with leader id ae199a41c247d59b31556e13d95e4300.
14:23:16.559 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 3a331bef465918e8cbe675a7c5e83a3b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.559 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 1f10924a53a30da094cc2390f240981f for job eb69507117e6ffaf90d8bea22e591f35 from resource manager with leader id ae199a41c247d59b31556e13d95e4300.
14:23:16.559 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 1f10924a53a30da094cc2390f240981f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:16.560 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_7 with leader id 8078b150-52ca-4294-8f28-2bd60b87bb2b.
14:23:16.562 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.562 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:23:16.564 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_7 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.564 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.564 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.565 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:23:16.565 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:16.565 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:23:16.566 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:23:16.569 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job eb69507117e6ffaf90d8bea22e591f35.
14:23:16.569 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:23:16.569 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id eb69507117e6ffaf90d8bea22e591f35
14:23:16.570 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:23:16.573 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:16.574 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:23:16.574 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:23:16.575 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:23:16.575 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:23:16.577 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x55d41229, L:/127.0.0.1:57334 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:16.578 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:23:16.578 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:23:16.580 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:16.582 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:16.587 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:23:16.589 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:23:16.590 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:23:16.591 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:23:16.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@797aba56
14:23:16.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:16.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:16.594 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.597 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.598 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x46d286b7, L:/127.0.0.1:35640 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:16.600 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:23:16.600 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:23:16.603 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6327b5c0, L:/127.0.0.1:38220 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:16.604 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:23:16.605 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:23:16.607 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:23:16.607 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:23:16.608 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@361931be
14:23:16.608 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:16.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:16.610 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:23:16.610 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:23:16.615 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48e33edd
14:23:16.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=122), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:16.621 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d3c37d6
14:23:16.625 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.625 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.626 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f1ef2780a92448bfb22fa93938bd9281 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:16.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:16.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:16.631 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:23:16.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:16.631 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:23:16.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:16.631 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:23:16.631 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:23:16.632 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:23:16.632 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=f1ef2780a92448bfb22fa93938bd9281@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:16.632 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC GetTableLocations: received response from server master-127.12.11.61:45967: OK, deferred=null)) after lookup
14:23:16.632 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] connecting to peer
14:23:16.633 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:23:16.635 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:23:16.635 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:23:16.636 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@397d7950
14:23:16.636 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:16.638 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:16.639 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:23:16.639 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:23:16.646 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:16.646 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] Successfully connected to peer
14:23:16.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55151da
14:23:16.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:23:16.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:23:16.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f5b9a
14:23:16.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:16.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:16.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:23:16.654 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:23:16.654 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:16.656 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.660 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:16.661 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:16.662 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:16.663 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.664 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:16.668 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:16.669 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7ee840d0
14:23:16.671 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xdda984ce, L:/127.0.0.1:40594 - R:/127.12.11.3:46811] using TOKEN/null
14:23:16.672 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:16.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:16.672 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.675 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.680 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:16.685 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:16.686 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xda192958, L:/127.0.0.1:57336 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:16.691 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.707 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.707 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:16.712 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xdc096751, L:/127.0.0.1:35642 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:16.712 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.713 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:16.713 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:16.714 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:16.714 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:16.715 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:16.717 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:16.725 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.725 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:16.726 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:16.727 [DEBUG - main] (Connection.java:748) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] connecting to peer
14:23:16.730 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.730 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=103), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:16.732 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.735 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.735 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:16.739 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.740 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7040a5d2
14:23:16.740 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4bcf91c7, L:/127.0.0.1:38226 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:16.742 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:23:16.742 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:23:16.744 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.745 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:16.745 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:16.745 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:16.745 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:16.746 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.746 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.748 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.748 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.751 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0b15f042, L:/127.0.0.1:57340 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:16.756 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x940336d0, L:/127.0.0.1:35646 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:16.761 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.761 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=135), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:16.765 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.766 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:16.769 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.771 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.771 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@156af7a
14:23:16.772 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:16.772 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:23:16.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:23:16.775 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd41f5e91, L:/127.0.0.1:38240 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:16.782 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:16.783 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:16.787 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:16.791 [DEBUG - kudu-nio-4] (Connection.java:757) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] Successfully connected to peer
14:23:16.798 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.798 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:23:16.799 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cc2752e7fc5a2642aaf8ba1a71205f529a8dcb5ec7fa24bdbc16a6bb718d1b79'}]
14:23:16.800 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3ae6277a, L:/127.0.0.1:57350 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:16.801 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.805 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:23:16.805 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='17cb07bef62520c1a7d3489e1387cc7a59a1b4396936e8858a198930e12a80a0'}]
14:23:16.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:16.808 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:23:16.814 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:16.814 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.817 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:16.820 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x45ea2a21, L:/127.0.0.1:37856 - R:/127.12.11.1:39911] using TOKEN/null
14:23:16.820 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.11.60:37961(127.12.11.60:37961)] Successfully connected to peer
14:23:16.822 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:23:16.824 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.60
14:23:16.832 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.835 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:23:16.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:16.838 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:16.840 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:16.843 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:16.844 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe62cfe9e, L:/127.0.0.1:57366 - R:/127.12.11.60:37961] using SASL/PLAIN
14:23:16.848 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.849 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:16.849 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:16.853 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:16.854 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.11.61:45967(127.12.11.61:45967)] Successfully connected to peer
14:23:16.855 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:16.858 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:16.861 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.863 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:16.864 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.61
14:23:16.850 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.11.62:39875(127.12.11.62:39875)] Successfully connected to peer
14:23:16.872 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.11.62
14:23:16.874 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.880 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.882 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.888 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x88505c2a, L:/127.0.0.1:35670 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:16.891 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.891 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8352da8c, L:/127.0.0.1:35656 - R:/127.12.11.61:45967] using SASL/PLAIN
14:23:16.897 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7cf83e17, L:/127.0.0.1:38270 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:16.898 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:16.901 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:16.904 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.904 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=231), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [76ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: OK, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [132ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:16.907 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:16.907 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.907 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=251), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: OK, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: OK, deferred=null) after lookup
14:23:16.913 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.913 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@575be8ef
14:23:16.917 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.918 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:16.923 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.924 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:16.925 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:16.925 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:16.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.926 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:16.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:16.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:16.927 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.929 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.929 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.929 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:16.929 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:16.930 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:23:16.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:23:16.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:23:16.936 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.936 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:16.938 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5442ecfd, L:/127.0.0.1:38254 - R:/127.12.11.62:39875] using SASL/PLAIN
14:23:16.938 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:16.939 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@34cea97b
14:23:16.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:23:16.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:23:16.942 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:16.943 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.944 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:16.949 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:16.962 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:16.965 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf2454208, L:/127.0.0.1:51464 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:16.996 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:16.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:23:16.999 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3e99b136008983c50cfe757ce9e5e1d619f5f7eab1469c20c4961113d4e9bf21'}]
14:23:17.001 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:17.005 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.006 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:23:17.007 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c72cbc1637bd794a97332b168a060a50a0dd3baab764a8f38d033a152b60e0c6'}]
14:23:17.008 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:17.009 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:23:17.011 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:23:17.027 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:23:17.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.028 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:23:17.029 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:17.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.034 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7287251748679680001) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.035 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [17cb07bef62520c1a7d3489e1387cc7a59a1b4396936e8858a198930e12a80a0]
14:23:17.035 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:23:17.035 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.039 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.039 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.039 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299973, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:17.040 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [17cb07bef62520c1a7d3489e1387cc7a59a1b4396936e8858a198930e12a80a0]
14:23:17.042 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0be167e9, L:/127.0.0.1:51472 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:17.045 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 17cb07bef62520c1a7d3489e1387cc7a59a1b4396936e8858a198930e12a80a0 finished by subtask 1; deferring removal (restored in pending)
14:23:17.045 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f1ef2780a92448bfb22fa93938bd9281 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:17.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:17.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.041 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:23:17.047 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:23:17.047 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:17.047 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=f1ef2780a92448bfb22fa93938bd9281@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299998, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299998}]
14:23:17.047 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:17.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f1ef2780a92448bfb22fa93938bd9281 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:17.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:17.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.048 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=f1ef2780a92448bfb22fa93938bd9281@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.051 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='335aa57f9e9dff4418eb8f2ef53368b3784ec30833774ce0c49dd6acc51f6fd0'}]
14:23:17.054 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287251748679680001) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.055 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [cc2752e7fc5a2642aaf8ba1a71205f529a8dcb5ec7fa24bdbc16a6bb718d1b79]
14:23:17.058 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:17.058 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:23:17.060 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cc2752e7fc5a2642aaf8ba1a71205f529a8dcb5ec7fa24bdbc16a6bb718d1b79]
14:23:17.060 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:23:17.060 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:23:17.060 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:17.061 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cc2752e7fc5a2642aaf8ba1a71205f529a8dcb5ec7fa24bdbc16a6bb718d1b79 finished by subtask 0; deferring removal (restored in pending)
14:23:17.062 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:17.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:17.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.064 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.068 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:17.070 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:17.080 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:17.080 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:17.080 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:17.080 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:23:17.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114197081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:17.084 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@30343a75, flushNotification=Deferred@1705924741(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:23:17.085 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] connecting to peer
14:23:17.089 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:17.092 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:17.099 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:17.111 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:17.112 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.121 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.121 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.124 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.127 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x753b23d0, L:/127.0.0.1:51474 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:17.127 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.127 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.135 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6802bcac, flushNotification=Deferred@1047823670(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:23:17.136 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] connecting to peer
14:23:17.136 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287251748679680001) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.137 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:23:17.137 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [3e99b136008983c50cfe757ce9e5e1d619f5f7eab1469c20c4961113d4e9bf21]
14:23:17.138 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:17.142 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb4d8f080, L:/127.0.0.1:51486 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:17.142 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.142 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.147 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.147 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.148 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] Successfully connected to peer
14:23:17.155 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.159 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7287251748679680001) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.159 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [c72cbc1637bd794a97332b168a060a50a0dd3baab764a8f38d033a152b60e0c6]
14:23:17.171 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:17.194 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf20bd2f7, L:/127.0.0.1:40602 - R:/127.12.11.3:46811] using TOKEN/null
14:23:17.223 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.223 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.240 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.240 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.249 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.249 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.251 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:17.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:17.252 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:17.253 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:23:17.255 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.255 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.264 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.272 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:17.278 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] Successfully connected to peer
14:23:17.287 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:23:17.301 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c72cbc1637bd794a97332b168a060a50a0dd3baab764a8f38d033a152b60e0c6]
14:23:17.301 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:23:17.301 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:23:17.302 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:17.302 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:17.303 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c72cbc1637bd794a97332b168a060a50a0dd3baab764a8f38d033a152b60e0c6 finished by subtask 2; deferring removal (restored in pending)
14:23:17.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:23:17.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3e99b136008983c50cfe757ce9e5e1d619f5f7eab1469c20c4961113d4e9bf21]
14:23:17.316 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3e99b136008983c50cfe757ce9e5e1d619f5f7eab1469c20c4961113d4e9bf21 finished by subtask 3; deferring removal (restored in pending)
14:23:17.318 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:23:17.318 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:23:17.318 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:17.319 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:17.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.323 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.324 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.325 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.326 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.327 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.327 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.327 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.327 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.328 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.328 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.328 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.329 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.329 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.329 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.329 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.329 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.331 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:17.331 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:17.331 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:17.332 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:17.335 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:17.350 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:17.352 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.352 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.359 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.359 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.369 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.369 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.371 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.382 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8441cbd2, L:/127.0.0.1:40610 - R:/127.12.11.3:46811] using TOKEN/null
14:23:17.384 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.387 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.403 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x55ea5328, L:/127.0.0.1:51502 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:17.423 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251748679680001) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.424 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [335aa57f9e9dff4418eb8f2ef53368b3784ec30833774ce0c49dd6acc51f6fd0]
14:23:17.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.444 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.449 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.449 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.454 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.454 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.460 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.460 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.477 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.477 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:17.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:17.478 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:23:17.478 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:17.499 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [335aa57f9e9dff4418eb8f2ef53368b3784ec30833774ce0c49dd6acc51f6fd0]
14:23:17.499 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:23:17.499 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:23:17.500 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:17.500 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:17.501 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 335aa57f9e9dff4418eb8f2ef53368b3784ec30833774ce0c49dd6acc51f6fd0 finished by subtask 1; deferring removal (restored in pending)
14:23:17.514 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:17.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:17.515 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:17.515 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:23:17.537 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:17.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:17.537 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:17.537 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:23:17.540 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.543 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.550 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job eb69507117e6ffaf90d8bea22e591f35 (4449 bytes, checkpointDuration=468 ms, finalizationTime=0 ms).
14:23:17.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:23:17.551 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 3e99b136008983c50cfe757ce9e5e1d619f5f7eab1469c20c4961113d4e9bf21 from pending
14:23:17.551 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 17cb07bef62520c1a7d3489e1387cc7a59a1b4396936e8858a198930e12a80a0 from pending
14:23:17.551 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split cc2752e7fc5a2642aaf8ba1a71205f529a8dcb5ec7fa24bdbc16a6bb718d1b79 from pending
14:23:17.551 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 335aa57f9e9dff4418eb8f2ef53368b3784ec30833774ce0c49dd6acc51f6fd0 from pending
14:23:17.551 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split c72cbc1637bd794a97332b168a060a50a0dd3baab764a8f38d033a152b60e0c6 from pending
14:23:17.551 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 5 finished splits from enumerator state
14:23:17.562 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.563 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.569 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.569 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.578 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.578 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114197581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:17.585 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@78ade06e, flushNotification=Deferred@66905386(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:23:17.589 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.590 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4c1a6585, flushNotification=Deferred@1748194440(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:23:17.590 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] connecting to peer
14:23:17.592 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] connecting to peer
14:23:17.649 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] Successfully connected to peer
14:23:17.662 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.662 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.662 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] Successfully connected to peer
14:23:17.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:17.673 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.673 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.683 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.684 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.698 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.716 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.730 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0c50bdca, L:/127.0.0.1:40612 - R:/127.12.11.3:46811] using TOKEN/null
14:23:17.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.764 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.764 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.770 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.770 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.774 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.775 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.780 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.786 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:17.820 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe67be29b, L:/127.0.0.1:37862 - R:/127.12.11.1:39911] using TOKEN/null
14:23:17.849 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.849 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.859 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.859 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:17.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:17.876 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.876 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:17.883 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.941 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=359 ms, finalizationTime=1 ms).
14:23:17.943 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:23:17.968 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.968 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:17.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:17.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:18.008 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.009 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:18.017 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.017 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:18.030 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.034 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:18.037 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:18.040 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:18.052 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:18.057 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:18.057 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:18.058 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:18.058 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:18.058 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:18.058 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:18.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f1ef2780a92448bfb22fa93938bd9281 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:18.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:18.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:18.065 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:18.065 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:18.065 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=f1ef2780a92448bfb22fa93938bd9281@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:18.072 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:18.075 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 16f4549a5d964ae882a20198bb0b6565
14:23:18.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:18.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:18.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:18.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:18.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:18.080 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:18.080 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.83.188:44337, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.83.188:44337: OK, deferred=null)) after lookup
14:23:18.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114198081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:18.094 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.095 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c727d8dcd101499c83395f60403d724d for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:18.104 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.104 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:18.105 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
14:23:18.107 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:23:18.113 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.113 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet e114fea09fd44768885e5a039ff61762 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:18.120 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:18.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:18.121 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:18.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.123 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:18.150 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.150 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 8479b7c28d58460a94f7a9353d62fda7 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:18.153 [DEBUG - main] (Connection.java:748) [peer 08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)] connecting to peer
14:23:18.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:18.174 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)] Successfully connected to peer
14:23:18.197 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.213 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xa73dd519, L:/127.0.0.1:52098 - R:/127.11.83.130:43593] using TOKEN/null
14:23:18.248 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f1ef2780a92448bfb22fa93938bd9281 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:18.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ff4eb90013ed4767bc44a96a380c1718 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:18.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8220d165661e4bb9b639b812c1b0bed0 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:18.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6516b49b7b42485aa6635e2668d6639f for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:18.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 5ba7dbab9aec46b79563c2133a1d4e41 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:18.257 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=f1ef2780a92448bfb22fa93938bd9281@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=ff4eb90013ed4767bc44a96a380c1718@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=8220d165661e4bb9b639b812c1b0bed0@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=6516b49b7b42485aa6635e2668d6639f@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811),b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=5ba7dbab9aec46b79563c2133a1d4e41@[43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)[L],b841c04c70cf49bba29d6e57b6ea4c6e(127.12.11.2:40867),e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:18.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC GetTableLocations: received response from server master-127.12.11.61:45967: OK, deferred=null)) after lookup
14:23:18.268 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.268 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:18.280 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.280 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:18.306 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.306 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:18.314 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.314 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:18.327 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.340 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.340 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c727d8dcd101499c83395f60403d724d for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:18.351 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.351 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:18.367 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.367 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet e114fea09fd44768885e5a039ff61762 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:18.378 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.378 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 8479b7c28d58460a94f7a9353d62fda7 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:18.388 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.400 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f1ef2780a92448bfb22fa93938bd9281, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.401 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f1ef2780a92448bfb22fa93938bd9281 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
14:23:18.425 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff4eb90013ed4767bc44a96a380c1718, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ff4eb90013ed4767bc44a96a380c1718 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
14:23:18.444 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8220d165661e4bb9b639b812c1b0bed0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.444 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 8220d165661e4bb9b639b812c1b0bed0 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
14:23:18.461 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:18.465 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:18.465 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:18.465 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:18.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:18.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:18.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:18.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:18.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:18.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.467 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:18.468 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.468 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.468 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.468 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:18.474 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='410231d85b75a1ea04b318643b7f346384a2125c1deb5bfd69f9fece47e19c02'}]
14:23:18.476 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:18.477 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:23:18.478 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:18.479 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6e6411baf5e4be7af73c99928f367c8d4288e64403e54fbb558b86f1d9a6b9df'}]
14:23:18.481 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:18.481 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1b312b7e9ce94ef4feb33421b034eedebdf954e80c799d8414bdd9a43d217389'}]
14:23:18.482 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='48cfc247b1050a62334fb7c24de34f9041b454c070456d6492510cd5fc43b74b'}]
14:23:18.484 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:18.486 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:23:18.487 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:18.488 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:23:18.489 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:18.492 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:18.493 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:23:18.495 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:18.499 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:18.503 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:18.510 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:18.540 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6516b49b7b42485aa6635e2668d6639f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.540 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 6516b49b7b42485aa6635e2668d6639f for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
14:23:18.540 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:18.541 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:18.541 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:18.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.542 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:18.542 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.542 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:18.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:18.543 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:18.552 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ba7dbab9aec46b79563c2133a1d4e41, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.553 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state READY
14:23:18.553 [DEBUG - main] (Connection.java:575) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] disconnecting while in state READY
14:23:18.553 [DEBUG - main] (Connection.java:575) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] disconnecting while in state READY
14:23:18.553 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state READY
14:23:18.553 [DEBUG - main] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state READY
14:23:18.553 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:18.553 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:18.553 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:18.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:18.553 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:18.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:18.555 [DEBUG - kudu-nio-4] (Connection.java:239) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] handling channelInactive
14:23:18.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] cleaning up while in state READY due to: connection closed
14:23:18.556 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.557 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.557 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:23:18.557 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:23:18.557 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
14:23:18.570 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:18.581 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:18.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114198581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:18.593 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job eb69507117e6ffaf90d8bea22e591f35 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:18.595 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:23:18.607 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:18.617 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:18.617 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.622 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5278a186, L:/127.0.0.1:52442 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:18.633 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:18.633 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:18.633 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:18.634 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:18.634 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] handling channelInactive
14:23:18.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:18.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] cleaning up while in state READY due to: connection closed
14:23:18.634 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:18.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:18.635 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
14:23:18.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:18.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:18.635 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:18.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:18.636214 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12620
14:23:18.637 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:18.637 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:18.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:18.637 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:18.639 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251756871680001) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.639 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [6e6411baf5e4be7af73c99928f367c8d4288e64403e54fbb558b86f1d9a6b9df]
14:23:18.639 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6e6411baf5e4be7af73c99928f367c8d4288e64403e54fbb558b86f1d9a6b9df]
14:23:18.640 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:23:18.640 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:23:18.641 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6e6411baf5e4be7af73c99928f367c8d4288e64403e54fbb558b86f1d9a6b9df finished by subtask 2; deferring removal (restored in pending)
14:23:18.641 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:18.641 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8ba0f4f151af6e18b77fce64f702f6a8bf57d35694dd8052c54bf41bfb401458'}]
14:23:18.643 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:18.644 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.646 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.652 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5795c20b, L:/127.0.0.1:52450 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:18.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:18.680 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:18.683 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:18.689 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:18.694 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251756871680001) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.694 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:18.698 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:23:18.695 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [410231d85b75a1ea04b318643b7f346384a2125c1deb5bfd69f9fece47e19c02]
14:23:18.695 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [410231d85b75a1ea04b318643b7f346384a2125c1deb5bfd69f9fece47e19c02]
14:23:18.704 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:23:18.704 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:23:18.704 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:18.704 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:18.705 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.705 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 410231d85b75a1ea04b318643b7f346384a2125c1deb5bfd69f9fece47e19c02 finished by subtask 0; deferring removal (restored in pending)
14:23:18.733 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.752 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:18.754 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.755 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8b439975, L:/127.0.0.1:52468 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:18.762 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6e051b2e, L:/127.0.0.1:52454 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:18.773 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] handling channelInactive
14:23:18.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] cleaning up while in state READY due to: connection closed
14:23:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:18.774420 13028 connection.cc:582] client connection to 127.12.11.1:39911 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:23:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:18.774916 13028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:23:18.779 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251756871680001) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.780 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [1b312b7e9ce94ef4feb33421b034eedebdf954e80c799d8414bdd9a43d217389]
14:23:18.780 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1b312b7e9ce94ef4feb33421b034eedebdf954e80c799d8414bdd9a43d217389]
14:23:18.781 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:23:18.781 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:23:18.782 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1b312b7e9ce94ef4feb33421b034eedebdf954e80c799d8414bdd9a43d217389 finished by subtask 3; deferring removal (restored in pending)
14:23:18.782 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:18.784 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:18.789726 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12783
14:23:18.809 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:23:18.809 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:18.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:18.810 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.818 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251756871680001) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.819 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [48cfc247b1050a62334fb7c24de34f9041b454c070456d6492510cd5fc43b74b]
14:23:18.819 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [48cfc247b1050a62334fb7c24de34f9041b454c070456d6492510cd5fc43b74b]
14:23:18.819 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:23:18.819 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:23:18.820 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:18.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:18.821 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.821 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:23:18.821 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 48cfc247b1050a62334fb7c24de34f9041b454c070456d6492510cd5fc43b74b finished by subtask 1; deferring removal (restored in pending)
14:23:18.821 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:18.823 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:18.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:18.824442 13028 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.11.1:39911, user_credentials={real_user=slave}} blocked reactor thread for 49570.3us
14:23:18.825 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.837 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:18.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:18.840602 13028 consensus_peers.cc:597] T ff4eb90013ed4767bc44a96a380c1718 P 43408dde659b44f5a0f27fdd2a5a1f97 -> Peer e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911): Couldn't send request to peer e2348a0f6cd84dffaa4fa04af9eaf0b9. Status: Network error: Client connection negotiation failed: client connection to 127.12.11.1:39911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:23:18.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:18.841114 13028 consensus_peers.cc:597] T 5ba7dbab9aec46b79563c2133a1d4e41 P 43408dde659b44f5a0f27fdd2a5a1f97 -> Peer e2348a0f6cd84dffaa4fa04af9eaf0b9 (127.12.11.1:39911): Couldn't send request to peer e2348a0f6cd84dffaa4fa04af9eaf0b9. Status: Network error: Client connection negotiation failed: client connection to 127.12.11.1:39911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:23:18.847 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:18.851 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1b082612, L:/127.0.0.1:52484 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:18.864 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:18.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:18.865 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.865 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:23:18.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:18.906544 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12951
14:23:18.910 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:18.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:18.910 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.910 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:23:18.926 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251756871680001) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:18.928 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [8ba0f4f151af6e18b77fce64f702f6a8bf57d35694dd8052c54bf41bfb401458]
14:23:18.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8ba0f4f151af6e18b77fce64f702f6a8bf57d35694dd8052c54bf41bfb401458]
14:23:18.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:23:18.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:23:18.929 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8ba0f4f151af6e18b77fce64f702f6a8bf57d35694dd8052c54bf41bfb401458 finished by subtask 2; deferring removal (restored in pending)
14:23:18.930 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:18.931 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:18.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:18.936702 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12344
14:23:18.975 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:18.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:18.975 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:18.975 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:23:19.007 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:19.007 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:19.016 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:19.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:19.017 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] handling channelInactive
14:23:19.017 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:19.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] cleaning up while in state READY due to: connection closed
14:23:19.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:19.017 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] handling channelInactive
14:23:19.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] cleaning up while in state READY due to: connection closed
14:23:19.017 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.11.62:39875(127.12.11.62:39875)] handling channelInactive
14:23:19.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state READY due to: connection closed
14:23:19.018 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] handling channelInactive
14:23:19.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] cleaning up while in state READY due to: connection closed
14:23:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:19.033465 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12415
14:23:19.084 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:19.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:19.084 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:19.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:19.085 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:19.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:19.085 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.11.61:45967(127.12.11.61:45967)] handling channelInactive
14:23:19.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state READY due to: connection closed
14:23:19.085 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114199082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:19.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:19.086592 12332 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12491
14:23:19.119 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job eb69507117e6ffaf90d8bea22e591f35 (4499 bytes, checkpointDuration=36 ms, finalizationTime=1 ms).
14:23:19.121 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:23:19.121 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 48cfc247b1050a62334fb7c24de34f9041b454c070456d6492510cd5fc43b74b from pending
14:23:19.121 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 410231d85b75a1ea04b318643b7f346384a2125c1deb5bfd69f9fece47e19c02 from pending
14:23:19.121 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 6e6411baf5e4be7af73c99928f367c8d4288e64403e54fbb558b86f1d9a6b9df from pending
14:23:19.121 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 1b312b7e9ce94ef4feb33421b034eedebdf954e80c799d8414bdd9a43d217389 from pending
14:23:19.121 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 8ba0f4f151af6e18b77fce64f702f6a8bf57d35694dd8052c54bf41bfb401458 from pending
14:23:19.121 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 5 finished splits from enumerator state
14:23:19.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:19.184 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:19.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:19.184 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:19.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:19.189 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:19.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:19.189 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.11.60:37961(127.12.11.60:37961)] handling channelInactive
14:23:19.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state READY due to: connection closed
14:23:19.494 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:19.495 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:19.495 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:19.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.496 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.496 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.496 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.497 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:19.584 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114199581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:19.597 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:23:19.599 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:23:19.640 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:19.641 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:19.641 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:19.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.641 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.641 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.644 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.644 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.644 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:19.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:19.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:19.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:19.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:19.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:19.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:19.956 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.956 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.956 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:19.956 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:20.012 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:20.013 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:20.013 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:20.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:20.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:20.013 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:20.014 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:20.014 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:20.014 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:20.040 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:20.041 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:20.041 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:20.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.042 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.042 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.042 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.043 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.043 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:20.091 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114200090 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:20.105 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:23:20.105 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:20.106 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:20.106 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:20.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.107 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.107 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.107 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.107 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:23:20.107 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:20.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:20.463 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:20.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:20.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:20.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:20.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:20.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:20.470 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:20.474 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='433de4019a1c14f354201a189004f72ac6549f298f46092ebbe33329c8181a0e'}]
14:23:20.475 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='68ae3a7346281f1504d82e5d3b411e8e8b1493a9aee713fdbeb0293e8d74fc7d'}]
14:23:20.476 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c4dfbe477938dc8947ae6198fdb11e7db9d7852055469df367ef0956a735cf63'}]
14:23:20.476 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:20.477 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b4b7488ad5480afea93ef18404c24df7bc819d189bbafecdae560df7327d1aea'}]
14:23:20.477 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:20.478 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:23:20.478 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:20.478 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:20.479 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:23:20.479 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:23:20.479 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:20.480 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:20.480 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:20.481 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:23:20.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:20.491 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:20.498 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:20.513 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:20.514 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:20.516 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:20.526 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:20.528 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:20.534 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:20.551 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:20.562 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:20.564 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:20.566 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:20.569 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbf227592, L:/127.0.0.1:52500 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:20.572 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:20.581 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:20.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114200582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:20.591 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251765063680001) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:20.591 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [c4dfbe477938dc8947ae6198fdb11e7db9d7852055469df367ef0956a735cf63]
14:23:20.591 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c4dfbe477938dc8947ae6198fdb11e7db9d7852055469df367ef0956a735cf63]
14:23:20.592 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:23:20.592 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:23:20.593 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:20.594 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c4dfbe477938dc8947ae6198fdb11e7db9d7852055469df367ef0956a735cf63 finished by subtask 3; deferring removal (restored in pending)
14:23:20.594 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='467963eaf51dbae2f20a1f183fe860b3fe9c1952825321af8b89eac547db586f'}]
14:23:20.596 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:20.598 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job eb69507117e6ffaf90d8bea22e591f35 (4499 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:23:20.600 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:23:20.600 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split c4dfbe477938dc8947ae6198fdb11e7db9d7852055469df367ef0956a735cf63 from pending
14:23:20.600 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 1 finished splits from enumerator state
14:23:20.601 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:20.602 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:23:20.603 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:20.605 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:20.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:20.606 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:20.606 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:23:20.606 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:20.619 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:20.620 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9c5f042d, L:/127.0.0.1:52506 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:20.626 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4a1afbfe, L:/127.0.0.1:52508 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:20.636 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:20.643 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:20.647 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1390643d, L:/127.0.0.1:52502 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:20.653 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:20.658 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251765063680001) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:20.658 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [68ae3a7346281f1504d82e5d3b411e8e8b1493a9aee713fdbeb0293e8d74fc7d]
14:23:20.659 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [68ae3a7346281f1504d82e5d3b411e8e8b1493a9aee713fdbeb0293e8d74fc7d]
14:23:20.659 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:23:20.659 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:23:20.660 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 68ae3a7346281f1504d82e5d3b411e8e8b1493a9aee713fdbeb0293e8d74fc7d finished by subtask 0; deferring removal (restored in pending)
14:23:20.660 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:20.661 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:20.662 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251765063680001) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:20.662 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [b4b7488ad5480afea93ef18404c24df7bc819d189bbafecdae560df7327d1aea]
14:23:20.663 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b4b7488ad5480afea93ef18404c24df7bc819d189bbafecdae560df7327d1aea]
14:23:20.663 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:23:20.663 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:23:20.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:20.663 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:20.664 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b4b7488ad5480afea93ef18404c24df7bc819d189bbafecdae560df7327d1aea finished by subtask 2; deferring removal (restored in pending)
14:23:20.671 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:20.675 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:20.678 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:20.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:20.679 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:20.679 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:23:20.680 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6eaffe0b, L:/127.0.0.1:52514 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:20.684 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:20.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:20.684 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:20.686 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:23:20.701 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251765063680001) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:20.701 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [433de4019a1c14f354201a189004f72ac6549f298f46092ebbe33329c8181a0e]
14:23:20.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [433de4019a1c14f354201a189004f72ac6549f298f46092ebbe33329c8181a0e]
14:23:20.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:23:20.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:23:20.703 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 433de4019a1c14f354201a189004f72ac6549f298f46092ebbe33329c8181a0e finished by subtask 1; deferring removal (restored in pending)
14:23:20.703 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:20.703 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:20.737 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:20.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:20.737 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:23:20.737 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:23:20.911 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251765063680001) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:20.912 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [467963eaf51dbae2f20a1f183fe860b3fe9c1952825321af8b89eac547db586f]
14:23:20.912 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [467963eaf51dbae2f20a1f183fe860b3fe9c1952825321af8b89eac547db586f]
14:23:20.912 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:23:20.912 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:23:20.913 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 467963eaf51dbae2f20a1f183fe860b3fe9c1952825321af8b89eac547db586f finished by subtask 3; deferring removal (restored in pending)
14:23:20.914 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:20.915 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:20.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:20.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:20.916 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:20.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:20.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:20.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:20.918 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:20.953 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:20.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:20.953 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:23:20.953 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:23:21.043 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:21.044 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:21.044 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:21.044 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:21.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114201081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:21.096 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job eb69507117e6ffaf90d8bea22e591f35 (3792 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:23:21.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:23:21.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 68ae3a7346281f1504d82e5d3b411e8e8b1493a9aee713fdbeb0293e8d74fc7d from pending
14:23:21.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split b4b7488ad5480afea93ef18404c24df7bc819d189bbafecdae560df7327d1aea from pending
14:23:21.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 433de4019a1c14f354201a189004f72ac6549f298f46092ebbe33329c8181a0e from pending
14:23:21.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 467963eaf51dbae2f20a1f183fe860b3fe9c1952825321af8b89eac547db586f from pending
14:23:21.098 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 4 finished splits from enumerator state
14:23:21.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:21.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114201581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:21.598 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:23:21.599 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:23:21.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:21.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:21Z chronyd exiting
14:23:22.090 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114202081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:22.104 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
14:23:22.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:23:22.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:22.454 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:22.455 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:22.455 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:22.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.456 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.456 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.457 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.457 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.457 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:22.460 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e992eac740c34f82a67ed784413d9dc9
14:23:22.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c727d8dcd101499c83395f60403d724d for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
14:23:22.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 466db4c4ffe14cf48387c9ef2e2e7bdb for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
14:23:22.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e114fea09fd44768885e5a039ff61762 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
14:23:22.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8479b7c28d58460a94f7a9353d62fda7 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
14:23:22.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c42eaec0d824e86a11149430f2d1456 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
14:23:22.469 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
14:23:22.473 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='dc7e72d22fe6a1c5a21e85894a9427bf04019d7c88982fe169ff1a3231219684'}]
14:23:22.473 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2fa456660ad92e78202223978a03950d62ac9c5536b24523ae2c4ab0d5d58c5d'}]
14:23:22.474 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e583913d165b62f66f4372292b20f224c5373e13cd378d303a3489b18763d2fc'}]
14:23:22.474 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:22.475 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:23:22.475 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:22.475 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299998, tablet=8479b7c28d58460a94f7a9353d62fda7@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)[L],bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:22.476 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='97570391d3c66c69df545aca9a296cb00c7ac1fb7fe395767a9a0fd38c9eddc6'}]
14:23:22.476 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:22.477 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:23:22.477 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:22.477 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=c727d8dcd101499c83395f60403d724d@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:22.477 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:23:22.478 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299998, tablet=e114fea09fd44768885e5a039ff61762@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:22.480 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:23:22.480 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)[L],645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)]}]
14:23:22.484 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:22.498 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:22.510 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:22.511 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:22.522 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:22.532 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:22.537 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:22.538 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:22.550 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:22.552 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:22.560 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:22.564 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:22.575 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:22.578 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:22.582 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe603a200, L:/127.0.0.1:52538 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:22.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114202582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:22.591 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:22.598 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251773259776001) for scanner KuduScanner(table=replication_test_table, tablet=e114fea09fd44768885e5a039ff61762, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:22.598 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [97570391d3c66c69df545aca9a296cb00c7ac1fb7fe395767a9a0fd38c9eddc6]
14:23:22.599 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job eb69507117e6ffaf90d8bea22e591f35 (4499 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:23:22.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [97570391d3c66c69df545aca9a296cb00c7ac1fb7fe395767a9a0fd38c9eddc6]
14:23:22.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:23:22.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:23:22.599 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.600 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.601 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 97570391d3c66c69df545aca9a296cb00c7ac1fb7fe395767a9a0fd38c9eddc6 finished by subtask 1; deferring removal (restored in pending)
14:23:22.601 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:23:22.601 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 97570391d3c66c69df545aca9a296cb00c7ac1fb7fe395767a9a0fd38c9eddc6 from pending
14:23:22.601 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:22.601 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 1 finished splits from enumerator state
14:23:22.602 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='89a064f48281ee844a5a33a8afbf4fe3b09887b677494892c4ccf6af3cb1f518'}]
14:23:22.603 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:22.604 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
14:23:22.605 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=2c42eaec0d824e86a11149430f2d1456@[08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593),645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751),bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)[L]]}]
14:23:22.605 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0552ae27, L:/127.0.0.1:52544 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:22.640 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] connecting to peer
14:23:22.642 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2642c57f, L:/127.0.0.1:52532 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:22.645 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.646 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:23:22.646 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.654 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251773259776001) for scanner KuduScanner(table=replication_test_table, tablet=c727d8dcd101499c83395f60403d724d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:22.655 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [2fa456660ad92e78202223978a03950d62ac9c5536b24523ae2c4ab0d5d58c5d]
14:23:22.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2fa456660ad92e78202223978a03950d62ac9c5536b24523ae2c4ab0d5d58c5d]
14:23:22.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:23:22.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:23:22.656 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2fa456660ad92e78202223978a03950d62ac9c5536b24523ae2c4ab0d5d58c5d finished by subtask 0; deferring removal (restored in pending)
14:23:22.656 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.657 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.659 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] Successfully connected to peer
14:23:22.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:22.672 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb6f51d14, L:/127.0.0.1:52524 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:22.676 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.83.131
14:23:22.679 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251773259776001) for scanner KuduScanner(table=replication_test_table, tablet=466db4c4ffe14cf48387c9ef2e2e7bdb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:22.679 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [e583913d165b62f66f4372292b20f224c5373e13cd378d303a3489b18763d2fc]
14:23:22.679 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e583913d165b62f66f4372292b20f224c5373e13cd378d303a3489b18763d2fc]
14:23:22.679 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:23:22.680 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:23:22.680 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e583913d165b62f66f4372292b20f224c5373e13cd378d303a3489b18763d2fc finished by subtask 2; deferring removal (restored in pending)
14:23:22.681 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.681 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.682 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.682 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.682 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.682 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:23:22.697 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:22.701 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.701 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.701 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.701 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3f69fe01, L:/127.0.0.1:52556 - R:/127.11.83.131:33751] using SASL/PLAIN
14:23:22.701 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:23:22.734 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251773259776001) for scanner KuduScanner(table=replication_test_table, tablet=2c42eaec0d824e86a11149430f2d1456, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:22.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [89a064f48281ee844a5a33a8afbf4fe3b09887b677494892c4ccf6af3cb1f518]
14:23:22.735 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [89a064f48281ee844a5a33a8afbf4fe3b09887b677494892c4ccf6af3cb1f518]
14:23:22.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
14:23:22.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
14:23:22.735 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.736 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 89a064f48281ee844a5a33a8afbf4fe3b09887b677494892c4ccf6af3cb1f518 finished by subtask 1; deferring removal (restored in pending)
14:23:22.736 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.767 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.767 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.768 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
14:23:22.809 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251773259776001) for scanner KuduScanner(table=replication_test_table, tablet=8479b7c28d58460a94f7a9353d62fda7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:23:22.810 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [dc7e72d22fe6a1c5a21e85894a9427bf04019d7c88982fe169ff1a3231219684]
14:23:22.810 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [dc7e72d22fe6a1c5a21e85894a9427bf04019d7c88982fe169ff1a3231219684]
14:23:22.810 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:23:22.810 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:23:22.811 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split dc7e72d22fe6a1c5a21e85894a9427bf04019d7c88982fe169ff1a3231219684 finished by subtask 3; deferring removal (restored in pending)
14:23:22.812 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.813 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.835 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.835 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.835 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.835 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer 08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)] disconnecting while in state READY
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state READY
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] disconnecting while in state READY
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state READY
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)] disconnecting while in state READY
14:23:22.916 [DEBUG - main] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state READY
14:23:22.917 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)] handling channelInactive
14:23:22.917 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 08b2c86b157d47fbbfaa5d11dcd304f0(127.11.83.130:43593)] cleaning up while in state READY due to: connection closed
14:23:22.917 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.83.188:44337(127.11.83.188:44337)] handling channelInactive
14:23:22.918 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state READY due to: connection closed
14:23:22.921 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] handling channelInactive
14:23:22.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 645f513b6cfd479a9020a5b95e6ce42b(127.11.83.131:33751)] cleaning up while in state READY due to: connection closed
14:23:22.921 [DEBUG - kudu-nio-4] (Connection.java:239) [peer bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)] handling channelInactive
14:23:22.921 [DEBUG - kudu-nio-4] (Connection.java:709) [peer bf18c755793a4c3bb04fd7fcb4a3a3c3(127.11.83.129:32843)] cleaning up while in state READY due to: connection closed
14:23:22.922 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.83.189:34071(127.11.83.189:34071)] handling channelInactive
14:23:22.922 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state READY due to: connection closed
14:23:22.922 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:22.926 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:22.926 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
14:23:22.927 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-3
14:23:22.927 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-1
14:23:22.927 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-5
14:23:22.929 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.83.190:41547(127.11.83.190:41547)] handling channelInactive
14:23:22.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state READY due to: connection closed
14:23:22.929 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:23:22.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:22.930470 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 11888
14:23:22.954 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:22.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:22.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:22.956 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.956 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:22.956 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.956 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:22.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:22.957 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:22.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:22.987737 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12043
14:23:23.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:23.037497 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 12192
14:23:23.064 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:23.065 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:23.065 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:23.065 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.065 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.065 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.066 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.066 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.066 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.066 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:23.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:23.074730 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 11610
14:23:23.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114203081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:23.095 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job eb69507117e6ffaf90d8bea22e591f35 (3792 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:23:23.098 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:23:23.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split e583913d165b62f66f4372292b20f224c5373e13cd378d303a3489b18763d2fc from pending
14:23:23.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 89a064f48281ee844a5a33a8afbf4fe3b09887b677494892c4ccf6af3cb1f518 from pending
14:23:23.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 2fa456660ad92e78202223978a03950d62ac9c5536b24523ae2c4ab0d5d58c5d from pending
14:23:23.098 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split dc7e72d22fe6a1c5a21e85894a9427bf04019d7c88982fe169ff1a3231219684 from pending
14:23:23.098 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 13 complete: removed 4 finished splits from enumerator state
14:23:23.110 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.83.190:41547(127.11.83.190:41547)] handling channelInactive
14:23:23.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state READY due to: connection closed
14:23:23.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:23.112401 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 11681
14:23:23.142 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.83.189:34071(127.11.83.189:34071)] handling channelInactive
14:23:23.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state READY due to: connection closed
14:23:23.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:23.142705 11598 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 11758
14:23:23.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:23.173 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.83.188:44337(127.11.83.188:44337)] handling channelInactive
14:23:23.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state READY due to: connection closed
14:23:23.240 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:23.241 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:23.241 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:23.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.242 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.242 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.242 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:23.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114203581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:23.591 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:23.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:23:23.671 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:23.860 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:23.860 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:23.860 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:23.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.861 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:23.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.861 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:23.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:23.861 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:24.084 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114204081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:24.093 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:24.094 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:23:24.164 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:24.165 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:24.165 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:24.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.166 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.166 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.166 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.166 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.166 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.166 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:24.171 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:24.174 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:24.174 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:24.175 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:24.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.175 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.175 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:24Z chronyd exiting
14:23:24.352 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:24.352 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:24.352 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:24.352 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:24.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:24.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:24.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:24.353 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:24.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:24.353 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:24.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:24.353 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:24.353 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:24.455 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.456 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.456 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.11.83.188:44337(127.11.83.188:44337) for tablet Kudu Master: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.459 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.460 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.460 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.460 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.460 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.462 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.462 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.462 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.479 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.479 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.480 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.480 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.480 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.480 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.499 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.499 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.500 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.500 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.500 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.519 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.519 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.519 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.520 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.520 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.520 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.520 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.520 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.520 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.520 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.520 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.524 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:24.524 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:24.524 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:24.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.525 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:24.559 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.559 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.560 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.560 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.560 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.560 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.560 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.560 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.560 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114204581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:24.589 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:23:24.589 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:23:24.618 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.619 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.620 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.620 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.620 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.620 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.620 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.620 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.621 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:24.678 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.680 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.680 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.680 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.919 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.920 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.920 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.921 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.921 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.921 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.921 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.921 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.921 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.921 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.921 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:24.940 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:24.940 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:24.940 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:24.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:24.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:24.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:24.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:24.979 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:24.979 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:24.979 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:24.979 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.979 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.979 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:24.980 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.980 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.980 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:24.980 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.980 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.980 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:24.980 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:25.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114205081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:25.089 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:23:25.090 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:23:25.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.14:23:25.265 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114205265
14:23:25.265 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114205265
14:23:25.268 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:23:25.270 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:23:25.271 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:23:25.271 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:23:25.271 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:23:25.271 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:23:25.273 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:23:25.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114205581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:25.583 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:23:25.584 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:23:25.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:25.588423 13677 mini_oidc.cc:150] Starting JWKS server
14:23:25.590 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:23:25.590 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:23:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:25.592782 13677 webserver.cc:533] Webserver started at http://127.0.0.1:44567/ using document root <none> and password file <none>
14:23:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:25.593282 13677 mini_oidc.cc:186] Starting OIDC Discovery server
14:23:25.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:25.595248 13677 webserver.cc:533] Webserver started at http://127.0.0.1:42483/ using document root <none> and password file <none>
14:23:25.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:25Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:23:25.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:25Z Disabled control of system clock
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:25.667622 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/logs
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data/info.pb
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.126:39961
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.126
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json with env {}
14:23:25.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:25.698 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:25.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:25.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:25.699 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:25.699 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:25.699 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:25.699 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:25.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:25.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:25.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:25.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:25.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:25.700 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:25.724 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:25.724 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:25.724 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:25.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.725 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.726 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:25.774 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:25.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:25.775 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:25.775 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:25.776 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.776 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.776 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:25.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.776 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.776 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:25.776 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:25.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.959275 13689 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:25.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.959865 13689 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:25.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.960384 13689 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.990840 13689 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.991178 13689 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.991508 13689 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.991827 13689 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:25.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.992085 13689 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:25.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:25.992293 13689 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44567/jwks.json
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:26.026042 13689 master_runner.cc:387] Master server non-default flags:
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.126:39961
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data/info.pb
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.126
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/logs
14:23:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:26.027568 13689 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:26.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:26.029273 13689 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:26.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:26.039813 13695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:26.098 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114206082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:26.113 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=30 ms, finalizationTime=1 ms).
14:23:26.114 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:23:26.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:26.583 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114206581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:26.600 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
14:23:26.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:23:26.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:26.959 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:26.959 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:26.960 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:26.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:26.961 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:26.961 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:26.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:26.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:26.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:26.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:26.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:26.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:26.963 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:27.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114207081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:27.100 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
14:23:27.102 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:23:27.171 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:27.213 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:27.213 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:27.213 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:27.214 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:27.214 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:27.214 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:27.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:27.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:27.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:27.215 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:27.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:27.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:27.215 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:26.041568 13696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:27.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.335007 13698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.336932 13697 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1290 milliseconds
14:23:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.337680 13689 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.297s	user 0.410s	sys 0.870s
14:23:27.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.337916 13689 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.297s	user 0.410s	sys 0.870s
14:23:27.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.338171 13689 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:27.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.339146 13689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:27.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.341559 13689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:27.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.342955 13689 hybrid_clock.cc:648] HybridClock initialized: now 1779114207342916 us; error 32 us; skew 500 ppm
14:23:27.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.344107 13689 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:27.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.352759 13689 webserver.cc:533] Webserver started at http://127.13.91.126:40893/ using document root <none> and password file <none>
14:23:27.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.354045 13689 fs_manager.cc:362] Metadata directory not provided
14:23:27.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.354329 13689 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:27.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.354923 13689 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:27.359 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:27.360 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:27.360 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:27.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.361 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:27.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.361924 13689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data/instance:
14:23:27.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8"
14:23:27.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:27 on dist-test-slave-1n46"
14:23:27.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.363446 13689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal/instance:
14:23:27.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8"
14:23:27.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:27 on dist-test-slave-1n46"
14:23:27.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.372855 13689 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
14:23:27.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.380787 13705 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:27.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.381948 13689 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
14:23:27.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.382357 13689 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal
14:23:27.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8"
14:23:27.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:27 on dist-test-slave-1n46"
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.382776 13689 fs_report.cc:389] FS layout report
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data/data
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:27.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:27.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.477644 13689 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:27.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.479027 13689 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:27.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.479460 13689 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:27.520 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:27.521 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:27.521 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:27.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:27.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:27.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:27.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.549168 13689 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.126:39961
14:23:27.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.549229 13757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.126:39961 every 8 connection(s)
14:23:27.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.551723 13689 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/data/info.pb
14:23:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.556813 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 13689
14:23:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.557144 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-0/wal/instance
14:23:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.557559 13758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.560146 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/logs
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data/info.pb
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.125:45957
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.125
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:27.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json with env {}
14:23:27.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.567965 13758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } has no permanent_uuid. Determining permanent_uuid...
14:23:27.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114207581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:27.592 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:23:27.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:23:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.594131 13758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } has no permanent_uuid. Determining permanent_uuid...
14:23:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.597044 13709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:27.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.601483 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:27.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.651002 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 1
14:23:27.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.654577 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:27.671 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:27.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.723042 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 2
14:23:27.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.726945 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.818360 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 3
14:23:27.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.822600 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:27.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.853751 13760 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:27.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.854219 13760 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:27.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.854682 13760 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:27.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.883270 13760 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:27.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.883512 13760 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:27.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.883699 13760 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:27.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.883903 13760 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:27.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.884070 13760 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:27.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.884200 13760 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44567/jwks.json
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.917428 13760 master_runner.cc:387] Master server non-default flags:
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data
14:23:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.125:45957
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data/info.pb
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.125
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/logs
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.918666 13760 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:27.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.920187 13760 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:27.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.929872 13769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:27.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:27.966010 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 4
14:23:27.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.972206 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:28.083 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114208081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:28.099 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:23:28.101 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:23:28.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:28.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:28.271771 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 5
14:23:28.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:28.278079 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:28.559 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:28.559 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:28.560 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:28.560 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:28.560 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:28.560 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:28.560 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:28.560 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:28.560 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:28.560 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:28.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:28.561 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:28.561 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:28.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114208581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:28.591 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:23:28.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:23:28.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:28.825583 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 6
14:23:28.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:28.837682 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.125:45957: Network error: Client connection negotiation failed: client connection to 127.13.91.125:45957: connect: Connection refused (error 111)
14:23:29.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114209082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:29.093 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:23:29.095 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:23:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:27.932149 13770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:29.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.134320 13772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:29.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.136687 13771 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1201 milliseconds
14:23:29.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.136868 13760 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:29.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.138190 13760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:29.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.140805 13760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:29.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.142174 13760 hybrid_clock.cc:648] HybridClock initialized: now 1779114209142140 us; error 36 us; skew 500 ppm
14:23:29.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.142999 13760 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:29.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.149763 13760 webserver.cc:533] Webserver started at http://127.13.91.125:39259/ using document root <none> and password file <none>
14:23:29.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.150712 13760 fs_manager.cc:362] Metadata directory not provided
14:23:29.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.150962 13760 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:29.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.151572 13760 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:29.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.156095 13760 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data/instance:
14:23:29.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5"
14:23:29.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:29 on dist-test-slave-1n46"
14:23:29.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.157183 13760 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal/instance:
14:23:29.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5"
14:23:29.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:29 on dist-test-slave-1n46"
14:23:29.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.163968 13760 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
14:23:29.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.169374 13782 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:29.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.170377 13760 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.170706 13760 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5"
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:29 on dist-test-slave-1n46"
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.171080 13760 fs_report.cc:389] FS layout report
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data/data
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:29.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:29.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:29.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.218372 13760 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:29.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.219894 13760 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:29.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.220330 13760 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:29.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.288100 13760 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.125:45957
14:23:29.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.288208 13833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.125:45957 every 8 connection(s)
14:23:29.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.290690 13760 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/data/info.pb
14:23:29.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.292125 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 13760
14:23:29.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.292626 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-1/wal/instance
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.295379 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:29.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/logs
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data/info.pb
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.124:35565
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.124
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json with env {}
14:23:29.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.297734 13834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:29.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.308737 13834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } has no permanent_uuid. Determining permanent_uuid...
14:23:29.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.329852 13834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } has no permanent_uuid. Determining permanent_uuid...
14:23:29.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.344452 13834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
14:23:29.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.346748 13783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.350517 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.399945 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 1
14:23:29.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.403861 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.472230 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 2
14:23:29.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.476203 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.504 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:29.505 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:29.505 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:29.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.505 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.506 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:29.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.567569 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 3
14:23:29.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.571085 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114209582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:29.590 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:23:29.591 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:23:29.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.599786 13836 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:29.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.600449 13836 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:29.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.601127 13836 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.631274 13836 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.631522 13836 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.631716 13836 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.631894 13836 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.632067 13836 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.632256 13836 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44567/jwks.json
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.666211 13836 master_runner.cc:387] Master server non-default flags:
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.124:35565
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44567/jwks.json
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data/info.pb
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.124
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:29.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/logs
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:29.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.667541 13836 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:29.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.669050 13836 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:29.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:29.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.678936 13846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:29.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.714555 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 4
14:23:29.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.718290 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:29.795 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:29.796 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:29.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.796 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:29.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:29.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:29.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:29.798 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:29.893 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:29.893 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:29.894 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:29.894 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:29.894 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:29.894 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:29.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:29.894 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:29.894 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:29.894 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:29.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:29.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:29.895 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:29.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.898267 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } attempt: 7
14:23:29.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:29.935644 13758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
14:23:29.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.958927 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.017463 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 1
14:23:30.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.017765 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 5
14:23:30.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.025876 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.026081 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.085 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114210081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:30.107 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
14:23:30.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.107595 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 2
14:23:30.109 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:23:30.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.115665 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:30.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.201249 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 3
14:23:30.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.207664 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.240 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:30.240 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:30.241 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:30.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.244 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:30.300 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:30.301 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:30.301 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:30.302 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.302 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.302 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:30.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.303 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:30.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:30.305 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:30.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.348141 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 4
14:23:30.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.354120 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.573678 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 6
14:23:30.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114210581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:30.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.591307 13834 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.594 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:23:30.596 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:23:30.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.637603 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 5
14:23:30.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.643687 13758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.91.124:35565: Network error: Client connection negotiation failed: client connection to 127.13.91.124:35565: connect: Connection refused (error 111)
14:23:30.671 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:30.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:29.680017 13847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:30.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.882439 13849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:30.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:30.884953 13848 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1200 milliseconds
14:23:30.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.885037 13836 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:30.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.886339 13836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:30.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.888625 13836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:30.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.890005 13836 hybrid_clock.cc:648] HybridClock initialized: now 1779114210889936 us; error 53 us; skew 500 ppm
14:23:30.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.890738 13836 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:30.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.896737 13836 webserver.cc:533] Webserver started at http://127.13.91.124:38411/ using document root <none> and password file <none>
14:23:30.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.897537 13836 fs_manager.cc:362] Metadata directory not provided
14:23:30.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.897716 13836 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:30.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.898176 13836 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.902217 13836 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data/instance:
14:23:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c78068b8f4de498caa453f54bd03c0cd"
14:23:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:30 on dist-test-slave-1n46"
14:23:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.903127 13836 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal/instance:
14:23:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c78068b8f4de498caa453f54bd03c0cd"
14:23:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:30 on dist-test-slave-1n46"
14:23:30.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.910120 13836 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
14:23:30.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.915940 13861 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:30.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.917014 13836 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:23:30.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.917274 13836 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal
14:23:30.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c78068b8f4de498caa453f54bd03c0cd"
14:23:30.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:30 on dist-test-slave-1n46"
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.917536 13836 fs_report.cc:389] FS layout report
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data/data
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:30.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:30.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.964460 13836 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:30.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.965816 13836 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:30.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:30.966265 13836 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.037683 13836 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.124:35565
14:23:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.037760 13912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.124:35565 every 8 connection(s)
14:23:31.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.040233 13836 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/data/info.pb
14:23:31.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.045624 13913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:31.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.046882 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 13836
14:23:31.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.047326 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/master-2/wal/instance
14:23:31.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.060854 13913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } has no permanent_uuid. Determining permanent_uuid...
14:23:31.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114211081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:31.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.093530 13913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } has no permanent_uuid. Determining permanent_uuid...
14:23:31.095 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:23:31.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:23:31.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.107224 13913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
14:23:31.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.124651 13913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: Bootstrap starting.
14:23:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.131649 13913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: Neither blocks nor log segments found. Creating new log.
14:23:31.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.133278 13913 log.cc:826] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: Log is configured to *not* fsync() on all Append() calls
14:23:31.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.137517 13913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: No bootstrap required, opened a new log
14:23:31.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.158243 13913 raft_consensus.cc:359] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.158865 13913 raft_consensus.cc:385] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:31.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.159132 13913 raft_consensus.cc:740] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c78068b8f4de498caa453f54bd03c0cd, State: Initialized, Role: FOLLOWER
14:23:31.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.159847 13913 consensus_queue.cc:260] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.162827 13922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.163702 13922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.164637 13913 sys_catalog.cc:565] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: configured and running, proceeding with master startup.
14:23:31.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:31.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:31.193184 13933 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:23:31.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:31.193671 13933 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:23:31.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.196199 13758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 6
14:23:31.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:31.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:31.220 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:31.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:31.220760 13867 tablet.cc:2404] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:31.221 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.221 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:31.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.223815 13758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: Bootstrap starting.
14:23:31.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.188766 13836 master_runner.cc:187] Error getting master registration for 127.13.91.126:39961: OK, instance_id { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" instance_seqno: 1779114207530719 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:31.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.229664 13836 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:31.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.231209 13758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: Neither blocks nor log segments found. Creating new log.
14:23:31.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.233451 13758 log.cc:826] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: Log is configured to *not* fsync() on all Append() calls
14:23:31.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.239046 13758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: No bootstrap required, opened a new log
14:23:31.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.240540 13922 raft_consensus.cc:493] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:31.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.241061 13922 raft_consensus.cc:515] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.243250 13922 leader_election.cc:290] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 208fcd03f51c44eabd1f8dab5e4fc9e8 (127.13.91.126:39961), 8b2ff5f503bb4beea04d2a3f0ace7de5 (127.13.91.125:45957)
14:23:31.259 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:31.259 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:31.259 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:31.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:31.260 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.260 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.260 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:31.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:31.260 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:31.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.269579 13758 raft_consensus.cc:359] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.270646 13758 raft_consensus.cc:385] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:31.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.270972 13758 raft_consensus.cc:740] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fcd03f51c44eabd1f8dab5e4fc9e8, State: Initialized, Role: FOLLOWER
14:23:31.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.272014 13758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.277668 13758 sys_catalog.cc:565] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: configured and running, proceeding with master startup.
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.277840 13733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c78068b8f4de498caa453f54bd03c0cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" is_pre_election: true
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.278635 13733 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c78068b8f4de498caa453f54bd03c0cd in term 0.
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.279945 13862 leader_election.cc:304] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fcd03f51c44eabd1f8dab5e4fc9e8, c78068b8f4de498caa453f54bd03c0cd; no voters: 
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.280818 13922 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.281136 13922 raft_consensus.cc:493] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.281426 13922 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 0 FOLLOWER]: Advancing to term 1
14:23:31.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.303776 13922 raft_consensus.cc:515] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.276480 13937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.318827 13733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c78068b8f4de498caa453f54bd03c0cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8"
14:23:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.319350 13733 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 0 FOLLOWER]: Advancing to term 1
14:23:31.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.327260 13733 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c78068b8f4de498caa453f54bd03c0cd in term 1.
14:23:31.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.317268 13937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.357743 13862 leader_election.cc:304] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fcd03f51c44eabd1f8dab5e4fc9e8, c78068b8f4de498caa453f54bd03c0cd; no voters: 
14:23:31.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.358603 13922 leader_election.cc:290] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [CANDIDATE]: Term 1 election: Requested vote from peers 208fcd03f51c44eabd1f8dab5e4fc9e8 (127.13.91.126:39961), 8b2ff5f503bb4beea04d2a3f0ace7de5 (127.13.91.125:45957)
14:23:31.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.360102 13922 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 1 FOLLOWER]: Leader election won for term 1
14:23:31.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.365279 13948 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:23:31.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.369148 13922 raft_consensus.cc:697] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [term 1 LEADER]: Becoming Leader. State: Replica: c78068b8f4de498caa453f54bd03c0cd, State: Running, Role: LEADER
14:23:31.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.370152 13922 consensus_queue.cc:237] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.392782 13949 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c78068b8f4de498caa453f54bd03c0cd. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.393623 13949 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: This master's current role is: LEADER
14:23:31.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.403340 13951 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:23:31.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.410400 13951 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:23:31.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.428659 13733 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [term 1 FOLLOWER]: Refusing update from remote peer c78068b8f4de498caa453f54bd03c0cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:31.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.430581 13949 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:31.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.372715 13689 master_runner.cc:187] Error getting master registration for 127.13.91.125:45957: OK, instance_id { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" instance_seqno: 1779114209270247 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:31.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.448017 13689 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:31.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.468792 13937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c78068b8f4de498caa453f54bd03c0cd. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.469267 13937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.494801 13951 catalog_manager.cc:1383] Generated new cluster ID: da4613cfce8a4e02b46d44fc3dbae695
14:23:31.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.495074 13951 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:23:31.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.497709 13949 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.498441 13949 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: This master's current role is: LEADER
14:23:31.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.501616 13937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.502218 13937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.563773 13951 catalog_manager.cc:1406] Generated new certificate authority record
14:23:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.568049 13951 catalog_manager.cc:1540] Loading token signing keys...
14:23:31.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114211581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:31.595 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:23:31.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:23:31.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.636086 13951 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd: Generated new TSK 0
14:23:31.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.637159 13951 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:23:31.644 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:31.644 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:31.645 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:31.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:31.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:31.645 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:31.645 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:31.645 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:31.645 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:31.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:31.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:31.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:31.646 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:31.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.651808 13834 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } attempt: 7
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.668833 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/logs
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data/info.pb
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.65:0
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.65
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.65
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:31.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:31.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:31.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.689888 13834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: Bootstrap starting.
14:23:31.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.696300 13834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: Neither blocks nor log segments found. Creating new log.
14:23:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.706496 13834 log.cc:826] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: Log is configured to *not* fsync() on all Append() calls
14:23:31.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.716012 13834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: No bootstrap required, opened a new log
14:23:31.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.740384 13834 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.741326 13834 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:31.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.741793 13834 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b2ff5f503bb4beea04d2a3f0ace7de5, State: Initialized, Role: FOLLOWER
14:23:31.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.742764 13834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } }
14:23:31.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.745857 13960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.747962 13960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.748986 13834 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: configured and running, proceeding with master startup.
14:23:31.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.749156 13808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c78068b8f4de498caa453f54bd03c0cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5"
14:23:31.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.749893 13808 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 0 FOLLOWER]: Advancing to term 1
14:23:31.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.753512 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c78068b8f4de498caa453f54bd03c0cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" is_pre_election: true
14:23:31.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.759769 13808 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c78068b8f4de498caa453f54bd03c0cd in term 1.
14:23:31.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.761003 13807 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [term 1 FOLLOWER]: Refusing update from remote peer c78068b8f4de498caa453f54bd03c0cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:31.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.768672 13922 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:31.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.812084 13960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c78068b8f4de498caa453f54bd03c0cd. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.812754 13960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.813907 13968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:31.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.814674 13968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5 [sys.catalog]: This master's current role is: FOLLOWER
14:23:31.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.839226 13976 catalog_manager.cc:1295] Loaded cluster ID: da4613cfce8a4e02b46d44fc3dbae695
14:23:31.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.844347 13976 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: loading cluster ID for follower catalog manager: success
14:23:31.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.851931 13976 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: acquiring CA information for follower catalog manager: success
14:23:31.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:31.857061 13976 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 8b2ff5f503bb4beea04d2a3f0ace7de5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:32.088 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114212088 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:32.100 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:23:32.101 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:23:32.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.149353 13958 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:32.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.149978 13958 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:32.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.150614 13958 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:32.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:32.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.204200 13958 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:32.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.205534 13958 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.91.65
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.266288 13958 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.65:0
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data/info.pb
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.65
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.65
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/logs
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:32.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:32.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.268772 13958 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:32.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.270704 13958 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:32.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.285178 13983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:32.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.401892 13922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c78068b8f4de498caa453f54bd03c0cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208fcd03f51c44eabd1f8dab5e4fc9e8" member_type: VOTER last_known_addr { host: "127.13.91.126" port: 39961 } } peers { permanent_uuid: "8b2ff5f503bb4beea04d2a3f0ace7de5" member_type: VOTER last_known_addr { host: "127.13.91.125" port: 45957 } } peers { permanent_uuid: "c78068b8f4de498caa453f54bd03c0cd" member_type: VOTER last_known_addr { host: "127.13.91.124" port: 35565 } } }
14:23:32.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.402882 13922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78068b8f4de498caa453f54bd03c0cd [sys.catalog]: This master's current role is: LEADER
14:23:32.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.408710 13948 catalog_manager.cc:1295] Loaded cluster ID: da4613cfce8a4e02b46d44fc3dbae695
14:23:32.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.409257 13948 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: loading cluster ID for follower catalog manager: success
14:23:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.432641 13948 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: acquiring CA information for follower catalog manager: success
14:23:32.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:32.448472 13948 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 208fcd03f51c44eabd1f8dab5e4fc9e8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:32.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114212581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:32.590 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:23:32.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:23:32.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:33.001 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:33.001 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:33.002 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.002 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.002 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.003 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.003 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.003 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:33.004 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.004 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.004 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.005 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:33.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114213081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:33.093 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:33.095 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:23:33.114 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:33.115 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:33.115 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:33.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.115 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.116 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.116 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.116 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:33.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:33.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114213581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:33.595 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:23:33.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:23:33.614 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:33.615 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:33.615 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.615 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:33.615 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.615 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:33.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:33.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:33.616 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:33.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:33.973 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:33.973 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:33.974 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:33.974 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:33.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:33.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:33.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:33.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:33.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:33.975 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:33.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:33.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:33.976 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:34.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114214081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:34.096 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:23:34.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:23:34.099 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:34.099 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:34.100 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:34.100 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:34.100 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:34.100 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:34.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:34.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:34.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:34.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:34.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:34.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:34.102 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:34.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:34.220 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:34.221 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:34.221 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:34.222 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.227 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:34.415 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:34.416 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:34.416 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:34.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.417 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.418 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.418 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.418 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.419 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.419 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.419 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.419 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:34.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114214581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:34.600 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:23:34.601 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:23:34.641 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:34.642 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:34.642 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:34.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.644 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.644 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.644 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.645 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.645 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:34.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:34.904 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:34.905 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:34.905 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:34.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.906 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:34.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:34.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.908 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:34.908 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:35.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114215081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:35.098 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:23:35.099 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:23:35.144 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:35.144 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:35.145 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:35.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:35.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:35.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:35.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:35.147 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:35.147 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:35.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:35.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:35.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:35.147 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:35.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:35.199 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:35.200 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:35.200 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:35.201 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:35.201 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:35.201 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:35.201 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:35.201 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:35.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:35.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:35.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:35.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:35.202 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:35.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114215582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:35.590 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:23:35.591 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:23:35.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:32.286746 13984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.069679 13986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.067170 13958 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.781s	user 0.863s	sys 1.433s
14:23:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.070127 13958 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.784s	user 0.864s	sys 1.433s
14:23:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.070392 13958 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.069131 13985 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 3782 milliseconds
14:23:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:33.689282 13982 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 13958
14:23:36.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.075659 13958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.078187 13958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:36.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.079682 13958 hybrid_clock.cc:648] HybridClock initialized: now 1779114216079615 us; error 69 us; skew 500 ppm
14:23:36.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.080586 13958 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:36.081 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114216081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:36.096 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:23:36.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:23:36.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.105829 13958 webserver.cc:533] Webserver started at http://127.13.91.65:41493/ using document root <none> and password file <none>
14:23:36.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.107064 13958 fs_manager.cc:362] Metadata directory not provided
14:23:36.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.107326 13958 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:36.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.107874 13958 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.113703 13958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data/instance:
14:23:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e86923de6e1d45a0bc9ef0df6fae4536"
14:23:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:36 on dist-test-slave-1n46"
14:23:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.115168 13958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal/instance:
14:23:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e86923de6e1d45a0bc9ef0df6fae4536"
14:23:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:36 on dist-test-slave-1n46"
14:23:36.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.124282 13958 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
14:23:36.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.131757 14001 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:36.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.133064 13958 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:23:36.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.133432 13958 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal
14:23:36.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e86923de6e1d45a0bc9ef0df6fae4536"
14:23:36.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:36 on dist-test-slave-1n46"
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.133847 13958 fs_report.cc:389] FS layout report
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data/data
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:36.172 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:36.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.226543 13958 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:36.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.228348 13958 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:36.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.228888 13958 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:36.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.245354 13958 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:36.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.250219 13958 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:36.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.250427 13958 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:36.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.250700 13958 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:36.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.250876 13958 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:36.415 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:36.416 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:36.416 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:36.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.416 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.416 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.417 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.417 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.417 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:36.420 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:36.420 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:36.420 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:36.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.421 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.421 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.422 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:36.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.431767 13958 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.65:40523
14:23:36.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.431860 14114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.65:40523 every 8 connection(s)
14:23:36.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.434363 13958 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/data/info.pb
14:23:36.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.438870 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 13958
14:23:36.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.439318 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-0/wal/instance
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.448311 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/logs
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data/info.pb
14:23:36.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.66:0
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.66
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.66
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:36.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.484369 14115 heartbeater.cc:344] Connected to a master server at 127.13.91.125:45957
14:23:36.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.484813 14115 heartbeater.cc:461] Registering TS with master...
14:23:36.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.486091 14115 heartbeater.cc:507] Master 127.13.91.125:45957 requested a full tablet report, sending...
14:23:36.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.490023 13799 ts_manager.cc:194] Registered new tserver with Master: e86923de6e1d45a0bc9ef0df6fae4536 (127.13.91.65:40523)
14:23:36.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.491119 14116 heartbeater.cc:344] Connected to a master server at 127.13.91.124:35565
14:23:36.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.491403 14116 heartbeater.cc:461] Registering TS with master...
14:23:36.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.492205 14116 heartbeater.cc:507] Master 127.13.91.124:35565 requested a full tablet report, sending...
14:23:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.494828 13878 ts_manager.cc:194] Registered new tserver with Master: e86923de6e1d45a0bc9ef0df6fae4536 (127.13.91.65:40523)
14:23:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.495802 14121 heartbeater.cc:344] Connected to a master server at 127.13.91.126:39961
14:23:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.496114 14121 heartbeater.cc:461] Registering TS with master...
14:23:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.496920 14121 heartbeater.cc:507] Master 127.13.91.126:39961 requested a full tablet report, sending...
14:23:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.497403 13878 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.91.65:53961
14:23:36.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.499766 13723 ts_manager.cc:194] Registered new tserver with Master: e86923de6e1d45a0bc9ef0df6fae4536 (127.13.91.65:40523)
14:23:36.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114216581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:36.596 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:23:36.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:23:36.659 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:36.659 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:36.660 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:36.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:36.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:36.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:36.660 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:36.660 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:36.660 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:36.660 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:36.660 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:36.660 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:36.660 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:36.672 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:36.712 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.712 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.713 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.713 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.713 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.713 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.713 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.714 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.714 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.714 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.715 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27763), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [15ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [30ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [31ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [48ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [94ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [105ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [105ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [164ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [165ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [186ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [303ms] refreshing cache from master, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [306ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [306ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [390ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [391ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [391ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [723ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [725ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [726ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [726ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2625ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4768ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [4768ms] too many traces: truncated at 100 traces, deferred=Deferred@296798164(state=PENDING, result=null, callback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391), errback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391)))
14:23:36.718 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.718 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.718 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27763), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [15ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [30ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [31ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [48ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [94ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [105ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [105ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [164ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [165ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [186ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [303ms] refreshing cache from master, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [306ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [306ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [390ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [391ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [391ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [723ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [725ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [726ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [726ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2625ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4768ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [4768ms] too many traces: truncated at 100 traces, deferred=Deferred@296798164(state=PENDING, result=null, callback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391), errback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27763), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [15ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [30ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [31ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [48ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [94ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [105ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [105ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [164ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [165ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [186ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [303ms] refreshing cache from master, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [306ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [306ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [390ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [391ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [391ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [723ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [725ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [726ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [726ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2625ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4768ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [4768ms] too many traces: truncated at 100 traces, deferred=Deferred@296798164(state=PENDING, result=null, callback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391), errback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:36.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.720 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:36.721 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:36.721 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:36.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.724 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.724 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.724 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.724 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:36.725 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27770), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [18ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [19ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [27ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [50ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [86ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [180ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [195ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [195ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [206ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [265ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [323ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [324ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [324ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [446ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [447ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [448ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [449ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [449ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [505ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [622ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [624ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [625ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [626ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [626ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1303ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1945ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1945ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2380ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2382ms] too many traces: truncated at 100 traces, deferred=Deferred@2077800537(state=PENDING, result=null, callback=(continuation of Deferred@1733228471 after retry RPC after error@784359847) -> (continuation of Deferred@333994247 after retry RPC after error@768352595) -> (continuation of Deferred@1034913810 after retry RPC after error@282008409) -> (continuation of Deferred@1094600742 after retry RPC after error@221528043) -> (continuation of Deferred@1285216583 after retry RPC after error@610731614) -> (continuation of Deferred@397084044 after retry RPC after error@994884597) -> (continuation of Deferred@554048826 after retry RPC after error@1028631218) -> (continuation of Deferred@1913085938 after retry RPC after error@743100756) -> (continuation of Deferred@1026876970 after retry RPC after error@2112798980) -> (continuation of Deferred@895412612 after retry RPC after error@1331973642) -> (continuation of Deferred@1442575482 after retry RPC after error@1586948384) -> (continuation of Deferred@482752959 after retry RPC after error@1908355123) -> (continuation of Deferred@2079146586 after retry RPC after error@316373998) -> (continuation of Deferred@1073587147 after retry RPC after error@927670959) -> (continuation of Deferred@648366478 after retry RPC after error@1877492415) -> (continuation of Deferred@1029265266 after retry RPC after error@1399411756) -> (continuation of Deferred@1603047158 after retry RPC after error@1918681602) -> (continuation of Deferred@88730108 after retry RPC after error@479724877) -> (continuation of Deferred@660132630 after retry RPC after error@864049453) -> (continuation of Deferred@2035044520 after retry RPC after error@631410849) -> (continuation of Deferred@1141057376 after retry RPC after error@1971013628) -> (continuation of Deferred@1848213739 after retry RPC after error@1606365719) -> (continuation of Deferred@39466663 after retry RPC after error@758240695) -> (continuation of Deferred@255665698 after retry RPC after error@691307096) -> (continuation of Deferred@2047370967 after retry RPC after error@1496811596), errback=(continuation of Deferred@1733228471 after retry RPC after error@784359847) -> (continuation of Deferred@333994247 after retry RPC after error@768352595) -> (continuation of Deferred@1034913810 after retry RPC after error@282008409) -> (continuation of Deferred@1094600742 after retry RPC after error@221528043) -> (continuation of Deferred@1285216583 after retry RPC after error@610731614) -> (continuation of Deferred@397084044 after retry RPC after error@994884597) -> (continuation of Deferred@554048826 after retry RPC after error@1028631218) -> (continuation of Deferred@1913085938 after retry RPC after error@743100756) -> (continuation of Deferred@1026876970 after retry RPC after error@2112798980) -> (continuation of Deferred@895412612 after retry RPC after error@1331973642) -> (continuation of Deferred@1442575482 after retry RPC after error@1586948384) -> (continuation of Deferred@482752959 after retry RPC after error@1908355123) -> (continuation of Deferred@2079146586 after retry RPC after error@316373998) -> (continuation of Deferred@1073587147 after retry RPC after error@927670959) -> (continuation of Deferred@648366478 after retry RPC after error@1877492415) -> (continuation of Deferred@1029265266 after retry RPC after error@1399411756) -> (continuation of Deferred@1603047158 after retry RPC after error@1918681602) -> (continuation of Deferred@88730108 after retry RPC after error@479724877) -> (continuation of Deferred@660132630 after retry RPC after error@864049453) -> (continuation of Deferred@2035044520 after retry RPC after error@631410849) -> (continuation of Deferred@1141057376 after retry RPC after error@1971013628) -> (continuation of Deferred@1848213739 after retry RPC after error@1606365719) -> (continuation of Deferred@39466663 after retry RPC after error@758240695) -> (continuation of Deferred@255665698 after retry RPC after error@691307096) -> (continuation of Deferred@2047370967 after retry RPC after error@1496811596)))
14:23:36.719 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.726 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:23:36.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.726 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.726 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27770), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [18ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [19ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [27ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [50ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [86ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [180ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [195ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [195ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [206ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [265ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [323ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [324ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [324ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [446ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [447ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [448ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [449ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [449ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [505ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [622ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [624ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [625ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [626ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [626ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1303ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1945ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1945ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2380ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2382ms] too many traces: truncated at 100 traces, deferred=Deferred@2077800537(state=PENDING, result=null, callback=(continuation of Deferred@1733228471 after retry RPC after error@784359847) -> (continuation of Deferred@333994247 after retry RPC after error@768352595) -> (continuation of Deferred@1034913810 after retry RPC after error@282008409) -> (continuation of Deferred@1094600742 after retry RPC after error@221528043) -> (continuation of Deferred@1285216583 after retry RPC after error@610731614) -> (continuation of Deferred@397084044 after retry RPC after error@994884597) -> (continuation of Deferred@554048826 after retry RPC after error@1028631218) -> (continuation of Deferred@1913085938 after retry RPC after error@743100756) -> (continuation of Deferred@1026876970 after retry RPC after error@2112798980) -> (continuation of Deferred@895412612 after retry RPC after error@1331973642) -> (continuation of Deferred@1442575482 after retry RPC after error@1586948384) -> (continuation of Deferred@482752959 after retry RPC after error@1908355123) -> (continuation of Deferred@2079146586 after retry RPC after error@316373998) -> (continuation of Deferred@1073587147 after retry RPC after error@927670959) -> (continuation of Deferred@648366478 after retry RPC after error@1877492415) -> (continuation of Deferred@1029265266 after retry RPC after error@1399411756) -> (continuation of Deferred@1603047158 after retry RPC after error@1918681602) -> (continuation of Deferred@88730108 after retry RPC after error@479724877) -> (continuation of Deferred@660132630 after retry RPC after error@864049453) -> (continuation of Deferred@2035044520 after retry RPC after error@631410849) -> (continuation of Deferred@1141057376 after retry RPC after error@1971013628) -> (continuation of Deferred@1848213739 after retry RPC after error@1606365719) -> (continuation of Deferred@39466663 after retry RPC after error@758240695) -> (continuation of Deferred@255665698 after retry RPC after error@691307096) -> (continuation of Deferred@2047370967 after retry RPC after error@1496811596), errback=(continuation of Deferred@1733228471 after retry RPC after error@784359847) -> (continuation of Deferred@333994247 after retry RPC after error@768352595) -> (continuation of Deferred@1034913810 after retry RPC after error@282008409) -> (continuation of Deferred@1094600742 after retry RPC after error@221528043) -> (continuation of Deferred@1285216583 after retry RPC after error@610731614) -> (continuation of Deferred@397084044 after retry RPC after error@994884597) -> (continuation of Deferred@554048826 after retry RPC after error@1028631218) -> (continuation of Deferred@1913085938 after retry RPC after error@743100756) -> (continuation of Deferred@1026876970 after retry RPC after error@2112798980) -> (continuation of Deferred@895412612 after retry RPC after error@1331973642) -> (continuation of Deferred@1442575482 after retry RPC after error@1586948384) -> (continuation of Deferred@482752959 after retry RPC after error@1908355123) -> (continuation of Deferred@2079146586 after retry RPC after error@316373998) -> (continuation of Deferred@1073587147 after retry RPC after error@927670959) -> (continuation of Deferred@648366478 after retry RPC after error@1877492415) -> (continuation of Deferred@1029265266 after retry RPC after error@1399411756) -> (continuation of Deferred@1603047158 after retry RPC after error@1918681602) -> (continuation of Deferred@88730108 after retry RPC after error@479724877) -> (continuation of Deferred@660132630 after retry RPC after error@864049453) -> (continuation of Deferred@2035044520 after retry RPC after error@631410849) -> (continuation of Deferred@1141057376 after retry RPC after error@1971013628) -> (continuation of Deferred@1848213739 after retry RPC after error@1606365719) -> (continuation of Deferred@39466663 after retry RPC after error@758240695) -> (continuation of Deferred@255665698 after retry RPC after error@691307096) -> (continuation of Deferred@2047370967 after retry RPC after error@1496811596)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:36.727 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
14:23:36.727 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27763), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [15ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [30ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [31ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [48ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [94ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [105ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [105ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [164ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [165ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [186ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [303ms] refreshing cache from master, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [306ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [306ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [390ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [391ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [391ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [723ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [725ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [726ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [726ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2625ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4768ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [4768ms] too many traces: truncated at 100 traces, deferred=Deferred@296798164(state=PENDING, result=null, callback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391), errback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27763), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [15ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [30ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [31ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [48ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [48ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [94ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [105ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [105ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [126ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [164ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [165ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [186ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [186ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [303ms] refreshing cache from master, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [305ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [306ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [306ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [389ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [390ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [391ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [391ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [723ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [725ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [726ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [726ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2625ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4768ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [4768ms] too many traces: truncated at 100 traces, deferred=Deferred@296798164(state=PENDING, result=null, callback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391), errback=(continuation of Deferred@973818147 after retry RPC after error@1798419350) -> (continuation of Deferred@530383777 after retry RPC after error@142928353) -> (continuation of Deferred@1755769731 after retry RPC after error@250435586) -> (continuation of Deferred@2040189557 after retry RPC after error@1459545926) -> (continuation of Deferred@165405929 after retry RPC after error@1838321816) -> (continuation of Deferred@1119157797 after retry RPC after error@1674704354) -> (continuation of Deferred@897296861 after retry RPC after error@1276438970) -> (continuation of Deferred@691303371 after retry RPC after error@1168567786) -> (continuation of Deferred@763068866 after retry RPC after error@1187636462) -> (continuation of Deferred@1290370519 after retry RPC after error@1053949981) -> (continuation of Deferred@1331098516 after retry RPC after error@1177649156) -> (continuation of Deferred@1093753552 after retry RPC after error@1875736579) -> (continuation of Deferred@402652221 after retry RPC after error@1568960358) -> (continuation of Deferred@371743196 after retry RPC after error@312555130) -> (continuation of Deferred@2052533767 after retry RPC after error@81166708) -> (continuation of Deferred@1348787851 after retry RPC after error@1273831451) -> (continuation of Deferred@134809719 after retry RPC after error@946140451) -> (continuation of Deferred@1317205026 after retry RPC after error@1825437713) -> (continuation of Deferred@751243087 after retry RPC after error@865413657) -> (continuation of Deferred@1785723821 after retry RPC after error@1768000385) -> (continuation of Deferred@2110278805 after retry RPC after error@1729586391)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:36.728 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:23:36.728 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:23:36.729 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:23:36.729 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
14:23:36.732 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.733 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.733 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.734 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.735 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
14:23:36.736 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
14:23:36.736 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
14:23:36.736 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:23:36.736 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
14:23:36.736 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:23:36.737 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
14:23:36.739 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
14:23:36.739 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
14:23:36.739 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
14:23:36.746 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
14:23:36.747 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:36.747 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1318) Discarding the results produced by task execution 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:23:36.750 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:23:36.750 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
14:23:36.750 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:23:36.750 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:23:36.750 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
14:23:36.750 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:23:36.752 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:23:36.752 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
14:23:36.752 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:23:36.752 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:23:36.752 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
14:23:36.752 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:23:36.753 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.753 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.754 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.756 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.757 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:23:36.757 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
14:23:36.757 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:23:36.758 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:23:36.759 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:23:36.759 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:23:36.759 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
14:23:36.760 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
14:23:36.761 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
14:23:36.761 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:36.766 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:36.766 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:36.766 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:36.767 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.767 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.767 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:36.767 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:36.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:36.768 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:36.769 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:36.769 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:23:36.772 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.773 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.773 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.773 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.773 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.773 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.773 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.774 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.792 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.793 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.793 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.794 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.794 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.794 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.818866 14122 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.819358 14122 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:36.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.819849 14122 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:36.832 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.832 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.832 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.834 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.854466 14122 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:36.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.855336 14122 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.91.66
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.889261 14122 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.66:0
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data/info.pb
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.66
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:36.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.66
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/logs
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.890636 14122 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:36.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:36.892139 14122 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:36.892 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.893 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.893 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.893 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.893 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.894 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.894 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.894 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.894 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.894 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.894 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:36.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.906812 14141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:36.972 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:36.972 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:36.972 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:36.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:36.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:36.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:36.975 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:37.024 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:37.025 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:37.025 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:37.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:37.026 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:37.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:37.026 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:37.026 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:37.026 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:37.026 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:37.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:37.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:37.027 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:37.028 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28069), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [18ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [22ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [48ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [51ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [53ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [145ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [146ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [146ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [146ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [163ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [183ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [184ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [185ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [223ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [284ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [285ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [285ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [384ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [384ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [523ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [524ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [525ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [525ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [563ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [563ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1044ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1044ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1461ms] refreshing cache from master, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1465ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1466ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1466ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5121ms] refreshing cache from master, [5122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [5124ms] too many traces: truncated at 100 traces, deferred=Deferred@337153820(state=PENDING, result=null, callback=(continuation of Deferred@833621821 after retry RPC after error@474683490) -> (continuation of Deferred@1900695221 after retry RPC after error@570056687) -> (continuation of Deferred@276985098 after retry RPC after error@1414457200) -> (continuation of Deferred@2010260650 after retry RPC after error@69470360) -> (continuation of Deferred@126687027 after retry RPC after error@609945045) -> (continuation of Deferred@1112183424 after retry RPC after error@1720595097) -> (continuation of Deferred@164992500 after retry RPC after error@1977375926) -> (continuation of Deferred@1662258719 after retry RPC after error@1956246046) -> (continuation of Deferred@1371976524 after retry RPC after error@1189637166) -> (continuation of Deferred@97515034 after retry RPC after error@1048444351) -> (continuation of Deferred@1514497519 after retry RPC after error@1607068565) -> (continuation of Deferred@634169680 after retry RPC after error@1947019347) -> (continuation of Deferred@93733152 after retry RPC after error@361994052) -> (continuation of Deferred@1440033423 after retry RPC after error@1208475606) -> (continuation of Deferred@2133792951 after retry RPC after error@1980729761) -> (continuation of Deferred@175264957 after retry RPC after error@2088620874) -> (continuation of Deferred@2073073362 after retry RPC after error@1910004352) -> (continuation of Deferred@1763131322 after retry RPC after error@2070042193) -> (continuation of Deferred@79391209 after retry RPC after error@923025316) -> (continuation of Deferred@1732127761 after retry RPC after error@235351673) -> (continuation of Deferred@1361898097 after retry RPC after error@1195575023) -> (continuation of Deferred@1368122546 after retry RPC after error@1716026396) -> (continuation of Deferred@1342275014 after retry RPC after error@262827351) -> (continuation of Deferred@17479268 after retry RPC after error@604472005) -> (continuation of Deferred@2134062286 after retry RPC after error@598683306) -> (continuation of Deferred@2000815405 after retry RPC after error@1875620010), errback=(continuation of Deferred@833621821 after retry RPC after error@474683490) -> (continuation of Deferred@1900695221 after retry RPC after error@570056687) -> (continuation of Deferred@276985098 after retry RPC after error@1414457200) -> (continuation of Deferred@2010260650 after retry RPC after error@69470360) -> (continuation of Deferred@126687027 after retry RPC after error@609945045) -> (continuation of Deferred@1112183424 after retry RPC after error@1720595097) -> (continuation of Deferred@164992500 after retry RPC after error@1977375926) -> (continuation of Deferred@1662258719 after retry RPC after error@1956246046) -> (continuation of Deferred@1371976524 after retry RPC after error@1189637166) -> (continuation of Deferred@97515034 after retry RPC after error@1048444351) -> (continuation of Deferred@1514497519 after retry RPC after error@1607068565) -> (continuation of Deferred@634169680 after retry RPC after error@1947019347) -> (continuation of Deferred@93733152 after retry RPC after error@361994052) -> (continuation of Deferred@1440033423 after retry RPC after error@1208475606) -> (continuation of Deferred@2133792951 after retry RPC after error@1980729761) -> (continuation of Deferred@175264957 after retry RPC after error@2088620874) -> (continuation of Deferred@2073073362 after retry RPC after error@1910004352) -> (continuation of Deferred@1763131322 after retry RPC after error@2070042193) -> (continuation of Deferred@79391209 after retry RPC after error@923025316) -> (continuation of Deferred@1732127761 after retry RPC after error@235351673) -> (continuation of Deferred@1361898097 after retry RPC after error@1195575023) -> (continuation of Deferred@1368122546 after retry RPC after error@1716026396) -> (continuation of Deferred@1342275014 after retry RPC after error@262827351) -> (continuation of Deferred@17479268 after retry RPC after error@604472005) -> (continuation of Deferred@2134062286 after retry RPC after error@598683306) -> (continuation of Deferred@2000815405 after retry RPC after error@1875620010)))
14:23:37.072 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:37.072 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:37.072 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:37.073 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.073 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.073 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.073 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.073 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.073 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.074 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.074 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:37.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114217081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:37.091 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:37.092 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:23:37.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:37.503090 14116 heartbeater.cc:499] Master 127.13.91.124:35565 was elected leader, sending a full tablet report...
14:23:37.572 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:37.573 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:37.573 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:37.574 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.574 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.574 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.574 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.574 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.574 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.574 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.574 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.574 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.575 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:37.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114217581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:37.596 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:23:37.598 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:23:37.872 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:37.872 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:37.873 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:37.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:37.874 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.874 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:37.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:37.874 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.012 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.013 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.013 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.014 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.083 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114218081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:38.130 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=49 ms, finalizationTime=0 ms).
14:23:38.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:23:38.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.309230 14140 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 14122
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.312423 14140 kernel_stack_watchdog.cc:198] Thread 14122 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.312813 14143 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:23:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:36.908170 14142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:38.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.317341 14122 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.409s	user 0.564s	sys 0.828s
14:23:38.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.317695 14122 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.410s	user 0.564s	sys 0.828s
14:23:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:38.319473 14144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.319473 14122 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:38.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.320866 14122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:38.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.323091 14122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:38.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.324478 14122 hybrid_clock.cc:648] HybridClock initialized: now 1779114218324406 us; error 51 us; skew 500 ppm
14:23:38.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.325455 14122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:38.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.331375 14122 webserver.cc:533] Webserver started at http://127.13.91.66:34201/ using document root <none> and password file <none>
14:23:38.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.332398 14122 fs_manager.cc:362] Metadata directory not provided
14:23:38.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.332649 14122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:38.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.333164 14122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:38.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.337430 14122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data/instance:
14:23:38.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66836e70c3d846479dcde68b865e926f"
14:23:38.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:38 on dist-test-slave-1n46"
14:23:38.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.338563 14122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal/instance:
14:23:38.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66836e70c3d846479dcde68b865e926f"
14:23:38.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:38 on dist-test-slave-1n46"
14:23:38.339 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:38.340 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:38.340 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:38.340 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:38.340 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:38.340 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:38.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:38.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:38.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:38.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:38.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:38.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:38.341 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.346630 14122 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
14:23:38.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.351853 14152 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.352762 14122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.001s
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.353096 14122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66836e70c3d846479dcde68b865e926f"
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:38 on dist-test-slave-1n46"
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.353381 14122 fs_report.cc:389] FS layout report
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data/data
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:38.365 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:23:38.366 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:23:38.366 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:23:38.366 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:23:38.367 [INFO - Thread-18] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:23:38.367 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
14:23:38.367 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:23:38.367 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:23:38.367 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:23:38.367 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:38.368 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:38.368 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
14:23:38.368 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:23:38.368 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:23:38.369 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
14:23:38.370 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:23:38.370 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
14:23:38.370 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:23:38.370 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:38.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
14:23:38.371 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:23:38.371 [INFO - Thread-18] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:23:38.371 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:38.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
14:23:38.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:23:38.372 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:23:38.372 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
14:23:38.372 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
14:23:38.372 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
14:23:38.372 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:23:38.372 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
14:23:38.372 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:23:38.372 [INFO - Thread-18] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:23:38.373 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:23:38.373 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65271219
14:23:38.373 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:38.374 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:38.374 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:23:38.374 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:23:38.374 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:23:38.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
14:23:38.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
14:23:38.375 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31f4cade
14:23:38.375 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:38.375 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:38.376 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:23:38.376 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:23:38.378 [DEBUG - Thread-18] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:38.378 [INFO - Thread-18] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:23:38.379 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:23:38.379 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
14:23:38.379 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c8371cc
14:23:38.379 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
14:23:38.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b8f8ca3
14:23:38.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:38.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:38.380 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:23:38.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:23:38.380 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:23:38.381 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@228f0b3e
14:23:38.382 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f993a69
14:23:38.382 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:38.383 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:38.383 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:38.384 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:38.384 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:38.384 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:38.385 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:38.386 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.386 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.387 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.388 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.391 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
14:23:38.391 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.391 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
14:23:38.392 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a2a9c61
14:23:38.392 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:38.392 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:23:38.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.392 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:23:38.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.393 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.393 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:23:38.393 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.394 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.395 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.396 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.396 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.398 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@42138015
14:23:38.398 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.398 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.398 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.399 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.399 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.400 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.400 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.400 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.400 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.401 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.402 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.402 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.402 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.403 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:38.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.404 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.404 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.405 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.405 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.406 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.406 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.406 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.406 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.407 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.407 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.407 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.407 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.407 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.408 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.408 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.409 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.411 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.411 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.412 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.414 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.415 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.418 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.419 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.419 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.419 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.419 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.419 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.422 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.422 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.422 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.422 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.422 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.425 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.426 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.426 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.426 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.426 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.426 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.427 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.427 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.427 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.427 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.427 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.427 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.428 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.429 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.430 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.430 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.434 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.434 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.434 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.435 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.434832 14122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:38.435 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.435 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.436 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.437079 14122 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:38.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.437786 14122 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:38.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.441305 14122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:38.446 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.446 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.446 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.446 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.447 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.447021 14122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:38.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.447314 14122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:38.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.447 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.447629 14122 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:38.447 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.447871 14122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:38.448 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.448 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.448 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.448 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.449 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.449 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.449 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.450 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.450 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.450 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.450 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.450 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.450 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.450 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.450 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.450 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.451 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.451 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.450 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.451 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.452 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.452 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.452 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.452 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.453 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.453 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.453 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.453 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.453 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.453 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.453 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.453 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.454 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.454 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.454 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.454 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.454 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.466 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.466 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.466 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.467 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.467 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.467 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.468 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.468 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.468 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.468 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.468 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.468 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.468 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.468 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.469 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.469 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.469 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.469 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.469 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.469 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.469 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.469 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.469 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.469 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.468 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.469 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.470 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.470 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.471 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.472 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.472 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.472 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.472 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.486 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.486 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.487 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.487 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.487 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.487 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.487 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.487 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.487 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.487 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.487 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.488 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.488 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.488 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.488 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.488 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.488 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.488 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.488 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.488 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.489 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.489 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.489 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.489 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.489 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.489 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.489 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.490 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [INFO - pool-104-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.490 [WARN - pool-104-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.491 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.505 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.505 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.505 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.506 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.507 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:38.527 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.527 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.528 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.528 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.528 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.528 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.528 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.528 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.528 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.529 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.529 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.529 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.528 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.529 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.529 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.529 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.529 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.530 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.530 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.530 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.530 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.530 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.529 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.531 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.531 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.548 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.548 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.549 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.549 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.549 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.550 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.555 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.556 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.556 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.565 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.566 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.566 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.566 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.567 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.567 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.567 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.567 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.567 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.567 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.567 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.567 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.568 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.568 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.568 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.568 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.568 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.568 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.568 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.568 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.567 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.568 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.569 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.569 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.570 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.570 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.568 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.570 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.570 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.571 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.571 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.571 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114218581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:38.586 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.586 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.586 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.587 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.587 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.587 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.588 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.589 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.589 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.589 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.591 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:38.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:23:38.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.593 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.626 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.626 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.626 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.627 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.627 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.628190 14122 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.66:36327
14:23:38.628 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.628294 14317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.66:36327 every 8 connection(s)
14:23:38.628 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.628 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.628 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.628 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.629 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.630789 14122 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/data/info.pb
14:23:38.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.637197 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14122
14:23:38.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.637723 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-1/wal/instance
14:23:38.665 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.665 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.666 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.667 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.667 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.666144 13677 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/logs
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data/info.pb
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.67:0
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.67
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.67
14:23:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:38.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.679344 14318 heartbeater.cc:344] Connected to a master server at 127.13.91.125:45957
14:23:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.679800 14318 heartbeater.cc:461] Registering TS with master...
14:23:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.680853 14318 heartbeater.cc:507] Master 127.13.91.125:45957 requested a full tablet report, sending...
14:23:38.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.683983 13799 ts_manager.cc:194] Registered new tserver with Master: 66836e70c3d846479dcde68b865e926f (127.13.91.66:36327)
14:23:38.688 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.689 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.689 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.689 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.689 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.689 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.692903 14319 heartbeater.cc:344] Connected to a master server at 127.13.91.124:35565
14:23:38.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.693225 14319 heartbeater.cc:461] Registering TS with master...
14:23:38.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.694001 14319 heartbeater.cc:507] Master 127.13.91.124:35565 requested a full tablet report, sending...
14:23:38.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.696128 13878 ts_manager.cc:194] Registered new tserver with Master: 66836e70c3d846479dcde68b865e926f (127.13.91.66:36327)
14:23:38.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.697427 13878 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.91.66:34127
14:23:38.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.699832 14320 heartbeater.cc:344] Connected to a master server at 127.13.91.126:39961
14:23:38.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.700182 14320 heartbeater.cc:461] Registering TS with master...
14:23:38.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.700802 14320 heartbeater.cc:507] Master 127.13.91.126:39961 requested a full tablet report, sending...
14:23:38.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:38.702899 13723 ts_manager.cc:194] Registered new tserver with Master: 66836e70c3d846479dcde68b865e926f (127.13.91.66:36327)
14:23:38.708 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.708 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.708 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.709 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.709 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.709 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.709 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.709 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.709 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.709 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.709 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.709 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.709 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.726 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.727 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.727 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.727 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.727 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.727 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.727 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.746 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.746 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.746 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.746 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.747 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.747 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.747 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.747 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.747 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.747 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.748 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.776 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.776 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.776 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.776 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.776 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.776 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.776 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.776 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.776 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.777 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29840), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [18ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [46ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [48ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [48ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [86ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [86ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [103ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [132ms] refreshing cache from master, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [135ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [138ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [156ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [156ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [184ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [186ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [186ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [242ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [262ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [505ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [505ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [563ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [564ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [564ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [582ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [582ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [583ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2460ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2463ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [4340ms] refreshing cache from master, [4340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4342ms] too many traces: truncated at 100 traces, deferred=Deferred@1698560525(state=PENDING, result=null, callback=(continuation of Deferred@1179178960 after retry RPC after error@1178903141) -> (continuation of Deferred@1410854614 after retry RPC after error@1592826827) -> (continuation of Deferred@1585852818 after retry RPC after error@1026750381) -> (continuation of Deferred@1454952323 after retry RPC after error@206321756) -> (continuation of Deferred@1672057574 after retry RPC after error@1233952417) -> (continuation of Deferred@1498973380 after retry RPC after error@884726123) -> (continuation of Deferred@455754680 after retry RPC after error@914276330) -> (continuation of Deferred@731738949 after retry RPC after error@1091012572) -> (continuation of Deferred@150547399 after retry RPC after error@1262175453) -> (continuation of Deferred@201068964 after retry RPC after error@1983405664) -> (continuation of Deferred@928965747 after retry RPC after error@651314153) -> (continuation of Deferred@1304954790 after retry RPC after error@2042075937) -> (continuation of Deferred@965379352 after retry RPC after error@234050763) -> (continuation of Deferred@759780 after retry RPC after error@1159752279) -> (continuation of Deferred@678397358 after retry RPC after error@1068353892) -> (continuation of Deferred@1665519042 after retry RPC after error@628187439) -> (continuation of Deferred@1911018202 after retry RPC after error@542163819) -> (continuation of Deferred@1832264062 after retry RPC after error@1138777582) -> (continuation of Deferred@207496778 after retry RPC after error@708044593) -> (continuation of Deferred@1985093336 after retry RPC after error@924590801) -> (continuation of Deferred@1242377742 after retry RPC after error@2134004241) -> (continuation of Deferred@435173361 after retry RPC after error@1336706228) -> (continuation of Deferred@1819459089 after retry RPC after error@29215572) -> (continuation of Deferred@434780973 after retry RPC after error@852006272) -> (continuation of Deferred@1270036478 after retry RPC after error@616280759) -> (continuation of Deferred@1824573022 after retry RPC after error@441592531) -> (continuation of Deferred@1217192608 after retry RPC after error@836493068) -> (continuation of Deferred@1539509599 after retry RPC after error@1347203142), errback=(continuation of Deferred@1179178960 after retry RPC after error@1178903141) -> (continuation of Deferred@1410854614 after retry RPC after error@1592826827) -> (continuation of Deferred@1585852818 after retry RPC after error@1026750381) -> (continuation of Deferred@1454952323 after retry RPC after error@206321756) -> (continuation of Deferred@1672057574 after retry RPC after error@1233952417) -> (continuation of Deferred@1498973380 after retry RPC after error@884726123) -> (continuation of Deferred@455754680 after retry RPC after error@914276330) -> (continuation of Deferred@731738949 after retry RPC after error@1091012572) -> (continuation of Deferred@150547399 after retry RPC after error@1262175453) -> (continuation of Deferred@201068964 after retry RPC after error@1983405664) -> (continuation of Deferred@928965747 after retry RPC after error@651314153) -> (continuation of Deferred@1304954790 after retry RPC after error@2042075937) -> (continuation of Deferred@965379352 after retry RPC after error@234050763) -> (continuation of Deferred@759780 after retry RPC after error@1159752279) -> (continuation of Deferred@678397358 after retry RPC after error@1068353892) -> (continuation of Deferred@1665519042 after retry RPC after error@628187439) -> (continuation of Deferred@1911018202 after retry RPC after error@542163819) -> (continuation of Deferred@1832264062 after retry RPC after error@1138777582) -> (continuation of Deferred@207496778 after retry RPC after error@708044593) -> (continuation of Deferred@1985093336 after retry RPC after error@924590801) -> (continuation of Deferred@1242377742 after retry RPC after error@2134004241) -> (continuation of Deferred@435173361 after retry RPC after error@1336706228) -> (continuation of Deferred@1819459089 after retry RPC after error@29215572) -> (continuation of Deferred@434780973 after retry RPC after error@852006272) -> (continuation of Deferred@1270036478 after retry RPC after error@616280759) -> (continuation of Deferred@1824573022 after retry RPC after error@441592531) -> (continuation of Deferred@1217192608 after retry RPC after error@836493068) -> (continuation of Deferred@1539509599 after retry RPC after error@1347203142)))
14:23:38.806 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:38.807 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:38.807 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:38.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:38.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:38.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:38.807 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.808 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:38.808 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.808 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.808 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.808 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.808 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.808 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.808 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.808 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.809 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.809 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.809 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.809 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.868 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.869 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.869 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.869 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.869 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.869 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.869 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.880 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:38.880 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:38.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.880 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:38.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:38.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:38.880 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.880 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.880 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:38.881 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:38.881 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29930), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [11ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [46ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [86ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [86ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [104ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [125ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [127ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [129ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1144ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1163ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1222ms] refreshing cache from master, [1222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1224ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1227ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1227ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1343ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1506ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1860ms] refreshing cache from master, [1860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1864ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1865ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1865ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2564ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2564ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2564ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2943ms] refreshing cache from master, [2943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2946ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2946ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2947ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [4161ms] refreshing cache from master, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4163ms] too many traces: truncated at 100 traces, deferred=Deferred@1289544861(state=PENDING, result=null, callback=(continuation of Deferred@1034217260 after retry RPC after error@267306009) -> (continuation of Deferred@389572527 after retry RPC after error@1013682649) -> (continuation of Deferred@653040895 after retry RPC after error@1608206903) -> (continuation of Deferred@185228156 after retry RPC after error@1796208285) -> (continuation of Deferred@700879975 after retry RPC after error@751434138) -> (continuation of Deferred@1975621316 after retry RPC after error@1634610687) -> (continuation of Deferred@2090268697 after retry RPC after error@535878456) -> (continuation of Deferred@1719540148 after retry RPC after error@1995428177) -> (continuation of Deferred@1030928805 after retry RPC after error@616733736) -> (continuation of Deferred@845648573 after retry RPC after error@973777145) -> (continuation of Deferred@312312204 after retry RPC after error@579763243) -> (continuation of Deferred@745730237 after retry RPC after error@1129371818) -> (continuation of Deferred@1027580077 after retry RPC after error@1812069381) -> (continuation of Deferred@1464667680 after retry RPC after error@303897067) -> (continuation of Deferred@1382545869 after retry RPC after error@828757584) -> (continuation of Deferred@241623634 after retry RPC after error@1959686196) -> (continuation of Deferred@428492529 after retry RPC after error@105043142) -> (continuation of Deferred@1057997358 after retry RPC after error@944196139) -> (continuation of Deferred@1932602908 after retry RPC after error@1665474648) -> (continuation of Deferred@580554924 after retry RPC after error@537825478) -> (continuation of Deferred@1521814293 after retry RPC after error@272148475) -> (continuation of Deferred@1724996256 after retry RPC after error@848133660), errback=(continuation of Deferred@1034217260 after retry RPC after error@267306009) -> (continuation of Deferred@389572527 after retry RPC after error@1013682649) -> (continuation of Deferred@653040895 after retry RPC after error@1608206903) -> (continuation of Deferred@185228156 after retry RPC after error@1796208285) -> (continuation of Deferred@700879975 after retry RPC after error@751434138) -> (continuation of Deferred@1975621316 after retry RPC after error@1634610687) -> (continuation of Deferred@2090268697 after retry RPC after error@535878456) -> (continuation of Deferred@1719540148 after retry RPC after error@1995428177) -> (continuation of Deferred@1030928805 after retry RPC after error@616733736) -> (continuation of Deferred@845648573 after retry RPC after error@973777145) -> (continuation of Deferred@312312204 after retry RPC after error@579763243) -> (continuation of Deferred@745730237 after retry RPC after error@1129371818) -> (continuation of Deferred@1027580077 after retry RPC after error@1812069381) -> (continuation of Deferred@1464667680 after retry RPC after error@303897067) -> (continuation of Deferred@1382545869 after retry RPC after error@828757584) -> (continuation of Deferred@241623634 after retry RPC after error@1959686196) -> (continuation of Deferred@428492529 after retry RPC after error@105043142) -> (continuation of Deferred@1057997358 after retry RPC after error@944196139) -> (continuation of Deferred@1932602908 after retry RPC after error@1665474648) -> (continuation of Deferred@580554924 after retry RPC after error@537825478) -> (continuation of Deferred@1521814293 after retry RPC after error@272148475) -> (continuation of Deferred@1724996256 after retry RPC after error@848133660)))
14:23:39.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:39.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.020373 14328 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:39.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.020927 14328 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:39.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.021437 14328 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:39.067 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:39.067 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:39.067 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:39.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.068614 14328 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:39.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.069 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:39.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.069797 14328 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.91.67
14:23:39.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114219081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:39.091 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:39.091 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:39.110293 14328 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.91.84:45163
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.91.67:0
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data/info.pb
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.91.67
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.91.126:39961,127.13.91.125:45957,127.13.91.124:35565
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.91.67
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/logs
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:39.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:39.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:39.111830 14328 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:39.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:39.113466 14328 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:39.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.125419 14334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:39.189 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:39.189 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:39.190 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.190 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.190 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.191 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.191 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.191 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.192 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:39.193 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.193 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.193 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:39.207 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:39.207 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:39.207 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:39.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.208 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.208 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.208 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.208 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.208 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:39.368 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:39.368 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:39.369 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:39.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.371 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.371 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.371 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.371 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:39.505 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:39.506 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:39.506 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:39.506 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.507 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.507 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.507 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:39.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:39.583 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114219582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:39.594 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:23:39.595 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:23:39.649 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:39.649 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:39.649 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:39.650 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.650 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.650 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:39.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.651 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:39.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:39.651 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:39.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:39.700802 14319 heartbeater.cc:499] Master 127.13.91.124:35565 was elected leader, sending a full tablet report...
14:23:39.947 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:39.947 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:39.947 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:39.948 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.948 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.948 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:39.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:39.949 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.949 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.949 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:39.949 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:40.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:40.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114220081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:40.111 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
14:23:40.112 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:23:40.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:39.126843 14335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:40.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:40.362586 14337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:40.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:40.364506 14336 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1234 milliseconds
14:23:40.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.364637 14328 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:40.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.365820 14328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:40.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.370807 14328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:40.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.372224 14328 hybrid_clock.cc:648] HybridClock initialized: now 1779114220372189 us; error 34 us; skew 500 ppm
14:23:40.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.372965 14328 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:40.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.379455 14328 webserver.cc:533] Webserver started at http://127.13.91.67:44501/ using document root <none> and password file <none>
14:23:40.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.380335 14328 fs_manager.cc:362] Metadata directory not provided
14:23:40.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.380511 14328 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:40.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.381067 14328 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:40.385 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:40.385 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:40.386 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:40.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.386 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.386 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.386524 14328 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data/instance:
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6642d6312be4fc98a209efce2f4539c"
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:40 on dist-test-slave-1n46"
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.387671 14328 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal/instance:
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6642d6312be4fc98a209efce2f4539c"
14:23:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:40 on dist-test-slave-1n46"
14:23:40.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.394586 14328 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
14:23:40.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.400056 14345 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.401036 14328 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
14:23:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.401304 14328 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal
14:23:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6642d6312be4fc98a209efce2f4539c"
14:23:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:40 on dist-test-slave-1n46"
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.401580 14328 fs_report.cc:389] FS layout report
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data/data
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:40.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.450726 14328 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.452364 14328 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.452768 14328 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:40.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.455211 14328 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:40.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.459326 14328 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:40.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.459498 14328 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:40.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.459705 14328 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:40.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.459844 14328 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:40.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:40.546 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:40.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:40.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:40.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.547 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.547 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:40.547 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.548 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:40.548 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.548 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.548 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:40.548 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:40.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114220581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:40.590 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:23:40.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:23:40.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.610855 14328 rpc_server.cc:307] RPC server started. Bound to: 127.13.91.67:35819
14:23:40.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.610948 14457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.91.67:35819 every 8 connection(s)
14:23:40.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.613168 14328 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/data/info.pb
14:23:40.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.618183 13677 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14328
14:23:40.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.618619 13677 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster1637758092141635204/ts-2/wal/instance
14:23:40.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.654920 14460 heartbeater.cc:344] Connected to a master server at 127.13.91.126:39961
14:23:40.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.655355 14460 heartbeater.cc:461] Registering TS with master...
14:23:40.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.656486 14458 heartbeater.cc:344] Connected to a master server at 127.13.91.125:45957
14:23:40.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.656625 14460 heartbeater.cc:507] Master 127.13.91.126:39961 requested a full tablet report, sending...
14:23:40.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.657307 14458 heartbeater.cc:461] Registering TS with master...
14:23:40.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.658360 14458 heartbeater.cc:507] Master 127.13.91.125:45957 requested a full tablet report, sending...
14:23:40.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.660048 13723 ts_manager.cc:194] Registered new tserver with Master: d6642d6312be4fc98a209efce2f4539c (127.13.91.67:35819)
14:23:40.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.662973 13799 ts_manager.cc:194] Registered new tserver with Master: d6642d6312be4fc98a209efce2f4539c (127.13.91.67:35819)
14:23:40.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.668397 14459 heartbeater.cc:344] Connected to a master server at 127.13.91.124:35565
14:23:40.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.668735 14459 heartbeater.cc:461] Registering TS with master...
14:23:40.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.669461 14459 heartbeater.cc:507] Master 127.13.91.124:35565 requested a full tablet report, sending...
14:23:40.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.671180 13878 ts_manager.cc:194] Registered new tserver with Master: d6642d6312be4fc98a209efce2f4539c (127.13.91.67:35819)
14:23:40.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.672609 13878 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.91.67:57945
14:23:40.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:40.678900 13677 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:23:40.690 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:23:40.690 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:23:40.691 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.91.126"
      port: 39961
    }
    bound_http_address {
      host: "127.13.91.126"
      port: 40893
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.91.125"
      port: 45957
    }
    bound_http_address {
      host: "127.13.91.125"
      port: 39259
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.91.124"
      port: 35565
    }
    bound_http_address {
      host: "127.13.91.124"
      port: 38411
    }
  }
}

14:23:40.691 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:23:40.692 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.91.65"
      port: 40523
    }
    bound_http_address {
      host: "127.13.91.65"
      port: 41493
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.91.66"
      port: 36327
    }
    bound_http_address {
      host: "127.13.91.66"
      port: 34201
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.91.67"
      port: 35819
    }
    bound_http_address {
      host: "127.13.91.67"
      port: 44501
    }
  }
}

14:23:40.692 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:23:40.694 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:40.694 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:23:40.695 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:23:40.695 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:23:40.695 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:23:40.699 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:23:41.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:41.018 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:23:41.018 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:23:41.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.021034 14468 mini_oidc.cc:150] Starting JWKS server
14:23:41.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.024191 14468 webserver.cc:533] Webserver started at http://127.0.0.1:36957/ using document root <none> and password file <none>
14:23:41.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.024606 14468 mini_oidc.cc:186] Starting OIDC Discovery server
14:23:41.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.026276 14468 webserver.cc:533] Webserver started at http://127.0.0.1:44025/ using document root <none> and password file <none>
14:23:41.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:23:41.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:23:41Z Disabled control of system clock
14:23:41.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114221081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.084950 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/logs
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data/info.pb
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.62:33795
14:23:41.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.62
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:41.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json with env {}
14:23:41.089 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.089 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.089 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:23:41.089 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.090 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.090 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.090 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.091 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.091 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.091 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.091 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.092 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:23:41.267 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.267 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.267 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.268 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.268 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.279 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:41.279 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:41.279 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:41.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:41.279 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:41.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:41.279 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:41.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:41.279 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:41.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:41.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:41.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:41.280 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:41.328 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.328 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.329 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.329 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.329 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.329 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.329 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.394562 14480 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:41.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.395040 14480 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:41.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.395437 14480 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.425879 14480 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.426168 14480 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.426358 14480 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.426635 14480 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:41.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.426959 14480 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:41.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.427192 14480 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36957/jwks.json
14:23:41.446 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.446 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.446 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.447 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.462829 14480 master_runner.cc:387] Master server non-default flags:
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.62:33795
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data/info.pb
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.62
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/logs
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:41.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.464253 14480 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:41.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.465778 14480 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:41.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.478654 14487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:41.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:41.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114221581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:41.603 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
14:23:41.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:23:41.667 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:41.667 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:41.668 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:41.668 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.668 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.668 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.668 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.669 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:41.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:41.675724 14459 heartbeater.cc:499] Master 127.13.91.124:35565 was elected leader, sending a full tablet report...
14:23:41.687 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.687 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.687 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.687 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.688 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.748 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:41.748 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:41.749 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:41.749 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.749 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.749 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:41.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:41.750 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.750 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.750 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:41.750 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:41.846 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:41.847 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:41.847 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:41.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.847 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:41.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:41.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:41.848 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:42.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:42.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114222081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:42.104 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
14:23:42.106 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:23:42.347 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:42.347 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:42.348 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:42.348 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.350 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:42.387 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:42.387 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:42.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.387 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:42.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.388 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:42.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:42.389 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.389 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.389 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:42.389 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:42.518 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:42.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114222582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:42.597 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:23:42.599 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:23:42.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:41.478660 14486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:42.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:42.794241 14480 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.318s	user 0.526s	sys 0.773s
14:23:42.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:42.794564 14480 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.319s	user 0.526s	sys 0.773s
14:23:42.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.796034 14480 server_base.cc:1061] running on GCE node
14:23:42.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:42.797739 14492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:42.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.798918 14480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:42.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.801596 14480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:42.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.802958 14480 hybrid_clock.cc:648] HybridClock initialized: now 1779114222802939 us; error 33 us; skew 500 ppm
14:23:42.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.803771 14480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:42.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.811688 14480 webserver.cc:533] Webserver started at http://127.14.33.62:37211/ using document root <none> and password file <none>
14:23:42.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.812610 14480 fs_manager.cc:362] Metadata directory not provided
14:23:42.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.812841 14480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:42.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.813333 14480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:42.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.817778 14480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data/instance:
14:23:42.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cab96c685c4378b215e0fe8a48b823"
14:23:42.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:42 on dist-test-slave-1n46"
14:23:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.818972 14480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal/instance:
14:23:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cab96c685c4378b215e0fe8a48b823"
14:23:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:42 on dist-test-slave-1n46"
14:23:42.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.826810 14480 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
14:23:42.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.832939 14497 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:42.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.834084 14480 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.005s
14:23:42.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.834333 14480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal
14:23:42.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cab96c685c4378b215e0fe8a48b823"
14:23:42.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:42 on dist-test-slave-1n46"
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.834713 14480 fs_report.cc:389] FS layout report
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data/data
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:42.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.916693 14480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:42.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.918232 14480 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:42.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.918673 14480 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:42.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.991761 14480 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.62:33795
14:23:42.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.991860 14548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.62:33795 every 8 connection(s)
14:23:42.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.994336 14480 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/data/info.pb
14:23:42.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.999536 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14480
14:23:43.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.999940 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-0/wal/instance
14:23:43.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:42.999975 14549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.003142 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/logs
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data/info.pb
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.61:38507
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.61
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:43.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:43.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:43.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:43.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:43.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json with env {}
14:23:43.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.011742 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } has no permanent_uuid. Determining permanent_uuid...
14:23:43.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:43.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.045281 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
14:23:43.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.048257 14498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.060537 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114223082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:43.090 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:23:43.091 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:23:43.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.110039 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 1
14:23:43.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.114596 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.182977 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 2
14:23:43.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.186630 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.278074 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 3
14:23:43.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.281924 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.335646 14551 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:43.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.336323 14551 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:43.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.336859 14551 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:43.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.366551 14551 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:43.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.366843 14551 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:43.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.367148 14551 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:43.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.367445 14551 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:43.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.367735 14551 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:43.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.367964 14551 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36957/jwks.json
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.400369 14551 master_runner.cc:387] Master server non-default flags:
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.61:38507
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data/info.pb
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.61
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/logs
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:43.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.401822 14551 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:43.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.403157 14551 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:43.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.412850 14560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:43.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.425312 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 4
14:23:43.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.431329 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:43.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:43.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:43.548 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:43.548 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.548 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.548 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.548 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.548 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.548 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.549 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.549 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.549 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.549 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:43.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114223581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:43.593 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:43.595 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:23:43.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:43.730804 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 5
14:23:43.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.737787 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:43.768 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:43.769 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:43.769 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:43.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.770 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.771 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.771 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.771 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.771 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:43.925 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:43.926 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:43.926 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:43.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:43.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.928 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:43.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:43.928 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:43.998 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:43.999 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:43.999 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:43.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:43.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:43.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:43.999 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:43.999 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:43.999 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:44.000 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:44.000 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:44.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:44.000 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:44.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:44.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114224081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:44.096 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:23:44.098 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:23:44.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.285300 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 6
14:23:44.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.308943 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.61:38507: Network error: Client connection negotiation failed: client connection to 127.14.33.61:38507: connect: Connection refused (error 111)
14:23:44.328 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:44.329 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:44.329 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:44.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.329 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.329 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.330 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:44.389 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:44.389 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:44.389 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:44.389 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.389 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:44.390 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.390 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.390 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:44.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.390 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.390 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:44.390 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:44.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:44.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114224581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:44.591 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:44.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.816112 14559 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 14551
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.925472 14559 kernel_stack_watchdog.cc:198] Thread 14551 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:23:44.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:23:44.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:43.414286 14561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:44.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.926885 14551 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.513s	user 0.002s	sys 0.000s
14:23:44.927 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:44.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.927304 14551 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.514s	user 0.002s	sys 0.000s
14:23:44.927 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:44.928 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:44.928 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:44.928 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:44.928 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:44.928 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:44.928 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:44.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:44.929 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:44.929 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:44.929 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:44.929 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:44.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.930761 14562 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1511 milliseconds
14:23:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:44.932313 14563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.932366 14551 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.933528 14551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:44.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.936074 14551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:44.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.937510 14551 hybrid_clock.cc:648] HybridClock initialized: now 1779114224937475 us; error 28 us; skew 500 ppm
14:23:44.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.938369 14551 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:44.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.943791 14551 webserver.cc:533] Webserver started at http://127.14.33.61:38985/ using document root <none> and password file <none>
14:23:44.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.944725 14551 fs_manager.cc:362] Metadata directory not provided
14:23:44.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.945003 14551 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:44.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.945505 14551 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:44.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.949734 14551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data/instance:
14:23:44.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "19688225b9384d659235a0d2b35c29ab"
14:23:44.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:44 on dist-test-slave-1n46"
14:23:44.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.950935 14551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal/instance:
14:23:44.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "19688225b9384d659235a0d2b35c29ab"
14:23:44.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:44 on dist-test-slave-1n46"
14:23:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.958231 14551 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:23:44.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.963392 14572 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.964257 14551 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
14:23:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.964507 14551 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal
14:23:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "19688225b9384d659235a0d2b35c29ab"
14:23:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:44 on dist-test-slave-1n46"
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:44.964942 14551 fs_report.cc:389] FS layout report
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data/data
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:45.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:45.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.041554 14551 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:45.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.043301 14551 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:45.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.043766 14551 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:45.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114225081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:45.092 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:23:45.093 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:23:45.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.129822 14551 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.61:38507
14:23:45.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.130013 14623 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.61:38507 every 8 connection(s)
14:23:45.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.132555 14551 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/data/info.pb
14:23:45.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.138669 14624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:45.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.142148 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14551
14:23:45.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.142513 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-1/wal/instance
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.144454 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/logs
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data/info.pb
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.60:39347
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.60
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json with env {}
14:23:45.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.148967 14624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } has no permanent_uuid. Determining permanent_uuid...
14:23:45.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.172538 14624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
14:23:45.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.185918 14624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } has no permanent_uuid. Determining permanent_uuid...
14:23:45.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.188161 14574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.191944 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.207 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:45.208 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:45.208 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:45.208 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.208 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.208 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.208 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.208 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.241415 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 1
14:23:45.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.244918 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.288 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:45.288 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:45.289 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:45.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:45.289 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:45.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:45.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:45.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.313369 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 2
14:23:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.317821 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.369438 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } attempt: 7
14:23:45.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.380339 14549 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } has no permanent_uuid. Determining permanent_uuid...
14:23:45.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.385751 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.409278 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 3
14:23:45.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.412976 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.444168 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 1
14:23:45.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.448225 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.469087 14627 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:45.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.469611 14627 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:45.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.470112 14627 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:45.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.499686 14627 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:23:45.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.499912 14627 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:45.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.500097 14627 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:23:45.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.500257 14627 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:23:45.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.500415 14627 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:23:45.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.500537 14627 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36957/jwks.json
14:23:45.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:45.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.529649 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 2
14:23:45.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.533532 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.534104 14627 master_runner.cc:387] Master server non-default flags:
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.60:39347
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36957/jwks.json
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data/info.pb
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.60
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/logs
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:45.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:45.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:45.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:45.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.535578 14627 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:45.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.537222 14627 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:45.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.548571 14639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:45.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.556376 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 4
14:23:45.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.563000 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114225581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:45.601 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=18 ms, finalizationTime=2 ms).
14:23:45.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:23:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.618937 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 3
14:23:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.630658 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.771181 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 4
14:23:45.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.783082 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:45.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:45.862413 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 5
14:23:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.868561 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:46.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:46.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.066567 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 5
14:23:46.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.074015 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:46.088 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114226085 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:46.099 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:23:46.100 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:23:46.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.416149 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 6
14:23:46.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.426303 14624 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:46.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:46.539 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [10ms] received response from server master-127.11.83.188:44337: OK, deferred=null) with no deferred attached!
14:23:46.584 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114226582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:46.610 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
14:23:46.614 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:23:46.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.630048 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 6
14:23:46.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.652920 14549 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.33.60:39347: Network error: Client connection negotiation failed: client connection to 127.14.33.60:39347: connect: Connection refused (error 111)
14:23:46.706 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:46.707 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:46.707 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:46.707 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:46.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:46.707 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:46.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:46.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:46.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:46.708 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:46.708 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:46.708 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:46.708 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:46.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:45.550385 14640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:46.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.875584 14627 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.328s	user 0.526s	sys 0.786s
14:23:46.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.875962 14627 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.328s	user 0.526s	sys 0.786s
14:23:46.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.879346 14627 server_base.cc:1061] running on GCE node
14:23:46.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:46.880771 14651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:46.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.881836 14627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:46.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.884145 14627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:46.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.885504 14627 hybrid_clock.cc:648] HybridClock initialized: now 1779114226885475 us; error 29 us; skew 500 ppm
14:23:46.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.886432 14627 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:46.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.894178 14627 webserver.cc:533] Webserver started at http://127.14.33.60:36045/ using document root <none> and password file <none>
14:23:46.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.895160 14627 fs_manager.cc:362] Metadata directory not provided
14:23:46.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.895386 14627 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:46.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.895910 14627 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:46.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.900590 14627 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data/instance:
14:23:46.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44a083cc60134524a6d64ddf0b9ee532"
14:23:46.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:46 on dist-test-slave-1n46"
14:23:46.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.901736 14627 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal/instance:
14:23:46.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44a083cc60134524a6d64ddf0b9ee532"
14:23:46.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:46 on dist-test-slave-1n46"
14:23:46.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.909839 14627 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.001s
14:23:46.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.916270 14656 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:46.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.917645 14627 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.918040 14627 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44a083cc60134524a6d64ddf0b9ee532"
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:46 on dist-test-slave-1n46"
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.918373 14627 fs_report.cc:389] FS layout report
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal
14:23:46.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data/data
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:46.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:46.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.983067 14627 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:46.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.984418 14627 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:46.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:46.984853 14627 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:47.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:47.027 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:47.027 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:47.028 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:47.028 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.028 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.028 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.029 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.029 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.029 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:47.047 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [7ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.047 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [5ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.064329 14627 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.60:39347
14:23:47.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.064462 14707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.60:39347 every 8 connection(s)
14:23:47.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.067121 14627 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/data/info.pb
14:23:47.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.067879 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14627
14:23:47.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.068274 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/master-2/wal/instance
14:23:47.075 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [3ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.075968 14708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:47.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114227082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:47.094 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:47.095 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:23:47.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.096042 14708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } has no permanent_uuid. Determining permanent_uuid...
14:23:47.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.117920 14708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } has no permanent_uuid. Determining permanent_uuid...
14:23:47.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.126617 14708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } has no permanent_uuid. Determining permanent_uuid...
14:23:47.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.142891 14708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: Bootstrap starting.
14:23:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.149878 14708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: Neither blocks nor log segments found. Creating new log.
14:23:47.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.152410 14708 log.cc:826] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: Log is configured to *not* fsync() on all Append() calls
14:23:47.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.156358 14708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: No bootstrap required, opened a new log
14:23:47.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.176272 14708 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.176928 14708 raft_consensus.cc:385] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:47.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.177201 14708 raft_consensus.cc:740] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a083cc60134524a6d64ddf0b9ee532, State: Initialized, Role: FOLLOWER
14:23:47.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.178067 14708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.180908 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.181603 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.182299 14708 sys_catalog.cc:565] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: configured and running, proceeding with master startup.
14:23:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.209321 14728 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:23:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.209623 14728 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:23:47.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.202764 14627 master_runner.cc:187] Error getting master registration for 127.14.33.62:33795: OK, instance_id { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" instance_seqno: 1779114222971862 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:47.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.224568 14627 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:47.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.239768 14662 tablet.cc:2404] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:47.267 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:47.268 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:47.268 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:47.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:47.306 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [23ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.307 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [24ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.307 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [23ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.307 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [25ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.312 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [17ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.328 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:47.328 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:47.329 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:47.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.329 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:47.332 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [19ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.332 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.12.11.61:45967, [17ms] received response from server master-127.12.11.61:45967: OK, deferred=null) with no deferred attached!
14:23:47.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.475827 14717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:47.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.476220 14717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.477993 14717 leader_election.cc:290] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4cab96c685c4378b215e0fe8a48b823 (127.14.33.62:33795), 19688225b9384d659235a0d2b35c29ab (127.14.33.61:38507)
14:23:47.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.486842 14624 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 7
14:23:47.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.514775 14624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: Bootstrap starting.
14:23:47.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:47.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.522015 14624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: Neither blocks nor log segments found. Creating new log.
14:23:47.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.524142 14624 log.cc:826] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: Log is configured to *not* fsync() on all Append() calls
14:23:47.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.530066 14624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: No bootstrap required, opened a new log
14:23:47.545 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:47.546 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:47.546 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:47.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:47.546 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.546 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:47.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:47.547 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:47.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.554975 14624 raft_consensus.cc:359] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.555733 14624 raft_consensus.cc:385] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:47.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.556046 14624 raft_consensus.cc:740] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19688225b9384d659235a0d2b35c29ab, State: Initialized, Role: FOLLOWER
14:23:47.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.556936 14624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.568418 14624 sys_catalog.cc:565] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: configured and running, proceeding with master startup.
14:23:47.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.568651 14599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a083cc60134524a6d64ddf0b9ee532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19688225b9384d659235a0d2b35c29ab" is_pre_election: true
14:23:47.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.569571 14599 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a083cc60134524a6d64ddf0b9ee532 in term 0.
14:23:47.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.570988 14657 leader_election.cc:304] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19688225b9384d659235a0d2b35c29ab, 44a083cc60134524a6d64ddf0b9ee532; no voters: 
14:23:47.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.571986 14717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:47.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.571717 14732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.572489 14717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:47.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.572731 14732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.572789 14717 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 0 FOLLOWER]: Advancing to term 1
14:23:47.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114227581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:47.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.584270 14717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.589699 14599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a083cc60134524a6d64ddf0b9ee532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19688225b9384d659235a0d2b35c29ab"
14:23:47.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.590482 14599 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 0 FOLLOWER]: Advancing to term 1
14:23:47.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.594632 14717 leader_election.cc:290] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [CANDIDATE]: Term 1 election: Requested vote from peers f4cab96c685c4378b215e0fe8a48b823 (127.14.33.62:33795), 19688225b9384d659235a0d2b35c29ab (127.14.33.61:38507)
14:23:47.606 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:23:47.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:23:47.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.620280 14599 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a083cc60134524a6d64ddf0b9ee532 in term 1.
14:23:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.622105 14657 leader_election.cc:304] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19688225b9384d659235a0d2b35c29ab, 44a083cc60134524a6d64ddf0b9ee532; no voters: 
14:23:47.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.625299 14717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 1 FOLLOWER]: Leader election won for term 1
14:23:47.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.636991 14717 raft_consensus.cc:697] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [term 1 LEADER]: Becoming Leader. State: Replica: 44a083cc60134524a6d64ddf0b9ee532, State: Running, Role: LEADER
14:23:47.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:47.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:47.640 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:47.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:47.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:47.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:47.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:47.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:47.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:47.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:47.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:47.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:47.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:47.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.639139 14717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.682983 14735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a083cc60134524a6d64ddf0b9ee532. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.683668 14735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: This master's current role is: LEADER
14:23:47.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.686399 14549 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } attempt: 7
14:23:47.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.690989 14746 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:23:47.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.677947 14551 master_runner.cc:187] Error getting master registration for 127.14.33.62:33795: OK, instance_id { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" instance_seqno: 1779114222971862 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:23:47.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.716280 14551 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:23:47.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.720603 14745 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:23:47.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.720898 14745 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:23:47.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.723486 14746 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:23:47.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.734444 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: Bootstrap starting.
14:23:47.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.745069 14549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: Neither blocks nor log segments found. Creating new log.
14:23:47.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.747166 14549 log.cc:826] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: Log is configured to *not* fsync() on all Append() calls
14:23:47.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.754637 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: No bootstrap required, opened a new log
14:23:47.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.762878 14599 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [term 1 FOLLOWER]: Refusing update from remote peer 44a083cc60134524a6d64ddf0b9ee532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:47.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.765654 14735 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:47.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.792951 14549 raft_consensus.cc:359] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.794133 14549 raft_consensus.cc:385] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:47.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.794545 14549 raft_consensus.cc:740] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cab96c685c4378b215e0fe8a48b823, State: Initialized, Role: FOLLOWER
14:23:47.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.795790 14549 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } }
14:23:47.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:47.801903 14578 tablet.cc:2404] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:47.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.806694 14549 sys_catalog.cc:565] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: configured and running, proceeding with master startup.
14:23:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.806977 14524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a083cc60134524a6d64ddf0b9ee532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4cab96c685c4378b215e0fe8a48b823" is_pre_election: true
14:23:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.807763 14524 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a083cc60134524a6d64ddf0b9ee532 in term 0.
14:23:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.810302 14752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.810909 14752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.819294 14522 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 0 FOLLOWER]: Advancing to term 1
14:23:47.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.834121 14523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a083cc60134524a6d64ddf0b9ee532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4cab96c685c4378b215e0fe8a48b823"
14:23:47.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.845767 14522 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [term 1 FOLLOWER]: Refusing update from remote peer 44a083cc60134524a6d64ddf0b9ee532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:47.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.847985 14735 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:23:47.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.865922 14752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a083cc60134524a6d64ddf0b9ee532. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.867075 14752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.873207 14749 mvcc.cc:204] Tried to move back new op lower bound from 7287251876868714496 to 7287251876452564992. Current Snapshot: MvccSnapshot[applied={T|T < 7287251876868714496}]
14:23:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.886032 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.886849 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: This master's current role is: LEADER
14:23:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.888957 14752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.889876 14752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823 [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.891566 14746 catalog_manager.cc:1383] Generated new cluster ID: 02b90c4acbb545a483a0971a25549a10
14:23:47.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.891803 14746 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:23:47.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.904412 14732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a083cc60134524a6d64ddf0b9ee532. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.905685 14732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.912407 14735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.914399 14735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 [sys.catalog]: This master's current role is: LEADER
14:23:47.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.917057 14751 mvcc.cc:204] Tried to move back new op lower bound from 7287251876868714496 to 7287251876452564992. Current Snapshot: MvccSnapshot[applied={T|T < 7287251876868714496}]
14:23:47.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.923075 14746 catalog_manager.cc:1406] Generated new certificate authority record
14:23:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.925918 14746 catalog_manager.cc:1540] Loading token signing keys...
14:23:47.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.938828 14732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44a083cc60134524a6d64ddf0b9ee532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cab96c685c4378b215e0fe8a48b823" member_type: VOTER last_known_addr { host: "127.14.33.62" port: 33795 } } peers { permanent_uuid: "19688225b9384d659235a0d2b35c29ab" member_type: VOTER last_known_addr { host: "127.14.33.61" port: 38507 } } peers { permanent_uuid: "44a083cc60134524a6d64ddf0b9ee532" member_type: VOTER last_known_addr { host: "127.14.33.60" port: 39347 } } }
14:23:47.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.939495 14732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab [sys.catalog]: This master's current role is: FOLLOWER
14:23:47.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.969785 14746 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532: Generated new TSK 0
14:23:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.970827 14746 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:47.993943 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/logs
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data/info.pb
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.1:0
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.1
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.1
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:48.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:48.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.032269 14770 catalog_manager.cc:1295] Loaded cluster ID: 02b90c4acbb545a483a0971a25549a10
14:23:48.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.032526 14770 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: loading cluster ID for follower catalog manager: success
14:23:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.043247 14770 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: acquiring CA information for follower catalog manager: success
14:23:48.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.048667 14770 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f4cab96c685c4378b215e0fe8a48b823: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:48.088 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:48.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:48.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:48.089 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:48.089 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:48.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:48.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:48.090 [INFO - pool-102-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:48.090 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:48.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:48.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:48.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:48.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:48.094 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114228090 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:48.102 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:23:48.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:23:48.479 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [4ms] received response from server master-127.11.83.188:44337: OK, deferred=null) with no deferred attached!
14:23:48.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:48.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.564118 14772 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:48.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.565116 14772 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:48.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.566149 14772 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:48.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114228582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:48.591 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:23:48.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:23:48.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.641332 14772 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:48.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.642781 14772 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.33.1
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.711946 14772 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.1:0
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data/info.pb
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.1
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.1
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/logs
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:48.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.714478 14772 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:48.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.716666 14772 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:48.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.726703 14745 catalog_manager.cc:1295] Loaded cluster ID: 02b90c4acbb545a483a0971a25549a10
14:23:48.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.727247 14745 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: loading cluster ID for follower catalog manager: success
14:23:48.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.742914 14745 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: acquiring CA information for follower catalog manager: success
14:23:48.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:48.749708 14745 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 19688225b9384d659235a0d2b35c29ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:23:48.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.755290 14778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:49.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:49.019 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:49.020 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:49.020 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:49.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.021 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.021 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.021 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.021 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:49.082 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114229082 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:49.092 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:23:49.094 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:23:49.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:49.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:49.486 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:49.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.489 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.489 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.489 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.489 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.489 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.489 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.490 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:49.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:49.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114229581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:49.598 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:23:49.600 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:23:49.879 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:49.879 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:49.880 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:49.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:49.881 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.881 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.881 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:49.882 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:49.882 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:49.989 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:49.989 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:49.990 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:49.990 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.990 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.990 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:49.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:49.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.994 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:49.995 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:50.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:50.087 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114230081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:50.100 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
14:23:50.101 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
14:23:50.166 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:50.167 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:50.167 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:50.167 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:50.167 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:50.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:50.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:50.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:50.167 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:50.168 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:50.168 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:50.169 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:50.169 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:50.439 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:50.439 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:50.440 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:50.440 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:50.441 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:50.441 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:50.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:50.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:50.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:50.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:50.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:50.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:50.443 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:50.478 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [6ms] received response from server master-127.11.83.188:44337: OK, deferred=null) with no deferred attached!
14:23:50.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:50.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114230582 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:50.592 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:50.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
14:23:50.707 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:50.707 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:50.707 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:50.707 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:50.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:50.708 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:50.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:50.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:50.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:50.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:50.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:50.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:50.708 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:50.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.140439 14777 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 14772
14:23:50.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.952670 14777 kernel_stack_watchdog.cc:198] Thread 14772 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 378ms:
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:48.765187 14779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.953060 14780 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:23:50.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.957919 14772 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.198s	user 0.653s	sys 0.994s
14:23:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.958349 14772 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.198s	user 0.654s	sys 0.994s
14:23:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:50.958967 14781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.958974 14772 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.962446 14772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:50.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.964718 14772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:50.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.966190 14772 hybrid_clock.cc:648] HybridClock initialized: now 1779114230966087 us; error 92 us; skew 500 ppm
14:23:50.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.967505 14772 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:50.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.975597 14772 webserver.cc:533] Webserver started at http://127.14.33.1:40955/ using document root <none> and password file <none>
14:23:50.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.977149 14772 fs_manager.cc:362] Metadata directory not provided
14:23:50.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.977509 14772 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:50.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.978334 14772 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.986809 14772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data/instance:
14:23:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63d18dedf3764a52adb9e90348858e1b"
14:23:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:50 on dist-test-slave-1n46"
14:23:50.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:50.988583 14772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal/instance:
14:23:50.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63d18dedf3764a52adb9e90348858e1b"
14:23:50.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:50 on dist-test-slave-1n46"
14:23:51.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.007915 14772 fs_manager.cc:696] Time spent creating directory manager: real 0.018s	user 0.014s	sys 0.002s
14:23:51.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:51.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.020668 14791 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:51.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.021844 14772 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.000s	sys 0.009s
14:23:51.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.022226 14772 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal
14:23:51.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63d18dedf3764a52adb9e90348858e1b"
14:23:51.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:50 on dist-test-slave-1n46"
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.022624 14772 fs_report.cc:389] FS layout report
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data/data
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:51.081 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114231081 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:51.091 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:23:51.092 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
14:23:51.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.113736 14772 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:51.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.115442 14772 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:51.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.115945 14772 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:51.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.119050 14772 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:51.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.124250 14772 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:51.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.124455 14772 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.124786 14772 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.125049 14772 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:51.268 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:51.268 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:51.268 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:51.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.269 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.269 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.269 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.269 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:51.427 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:51.428 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:51.428 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:51.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:51.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:51.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:51.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:51.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:51.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:51.436 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:51.436 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:51.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:51.436 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:51.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.442704 14772 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.1:43269
14:23:51.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.442862 14904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.1:43269 every 8 connection(s)
14:23:51.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.447538 14772 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/data/info.pb
14:23:51.448 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:51.448 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:51.448 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:51.448 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.448 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.449 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:51.449 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.449 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.449 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:51.449 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.450 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:51.450 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:51.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.449502 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14772
14:23:51.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.450117 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-0/wal/instance
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.466204 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/logs
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data/info.pb
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.2:0
14:23:51.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.2
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.2
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:51.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:51.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:51.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.527947 14912 heartbeater.cc:344] Connected to a master server at 127.14.33.62:33795
14:23:51.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.528460 14912 heartbeater.cc:461] Registering TS with master...
14:23:51.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.529584 14912 heartbeater.cc:507] Master 127.14.33.62:33795 requested a full tablet report, sending...
14:23:51.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.533555 14514 ts_manager.cc:194] Registered new tserver with Master: 63d18dedf3764a52adb9e90348858e1b (127.14.33.1:43269)
14:23:51.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.535271 14908 heartbeater.cc:344] Connected to a master server at 127.14.33.61:38507
14:23:51.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.535591 14908 heartbeater.cc:461] Registering TS with master...
14:23:51.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.536564 14908 heartbeater.cc:507] Master 127.14.33.61:38507 requested a full tablet report, sending...
14:23:51.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.540503 14589 ts_manager.cc:194] Registered new tserver with Master: 63d18dedf3764a52adb9e90348858e1b (127.14.33.1:43269)
14:23:51.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.550897 14905 heartbeater.cc:344] Connected to a master server at 127.14.33.60:39347
14:23:51.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.551209 14905 heartbeater.cc:461] Registering TS with master...
14:23:51.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.552085 14905 heartbeater.cc:507] Master 127.14.33.60:39347 requested a full tablet report, sending...
14:23:51.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.560581 14673 ts_manager.cc:194] Registered new tserver with Master: 63d18dedf3764a52adb9e90348858e1b (127.14.33.1:43269)
14:23:51.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.566673 14673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.33.1:55875
14:23:51.582 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114231581 for job eb69507117e6ffaf90d8bea22e591f35.
14:23:51.591 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job eb69507117e6ffaf90d8bea22e591f35 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:23:51.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
14:23:51.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.680 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.681 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.681 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.681 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=27225), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [1ms] received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [45ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [464ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [525ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1243ms] refreshing cache from master, [1243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1245ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2503ms] refreshing cache from master, [2503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2505ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2506ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2508ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4103ms] refreshing cache from master, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4106ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4106ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6764ms] refreshing cache from master, [6764ms] too many traces: truncated at 100 traces, deferred=Deferred@1683807042(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@14ef3558 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567)))
14:23:51.682 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.682 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.682 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.683 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=27225), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [1ms] received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [45ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [464ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [525ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1243ms] refreshing cache from master, [1243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1245ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2503ms] refreshing cache from master, [2503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2505ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2506ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2508ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4103ms] refreshing cache from master, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4106ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4106ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6764ms] refreshing cache from master, [6764ms] too many traces: truncated at 100 traces, deferred=Deferred@1683807042(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@14ef3558 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=27225), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [1ms] received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [45ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [464ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [525ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1243ms] refreshing cache from master, [1243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1245ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2503ms] refreshing cache from master, [2503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2505ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2506ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2508ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4103ms] refreshing cache from master, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4106ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4106ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6764ms] refreshing cache from master, [6764ms] too many traces: truncated at 100 traces, deferred=Deferred@1683807042(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@14ef3558 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.189:34071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:51.684 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.684 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.684 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.684 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.684 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.685 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.689 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=27225), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [1ms] received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [45ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [464ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [525ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1243ms] refreshing cache from master, [1243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1245ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2503ms] refreshing cache from master, [2503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2505ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2506ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2508ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4103ms] refreshing cache from master, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4106ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4106ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6764ms] refreshing cache from master, [6764ms] too many traces: truncated at 100 traces, deferred=Deferred@1683807042(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@14ef3558 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=27225), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [1ms] received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [45ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [464ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [525ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1243ms] refreshing cache from master, [1243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1245ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2503ms] refreshing cache from master, [2503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2505ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2506ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2508ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4103ms] refreshing cache from master, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4105ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [4106ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4106ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6764ms] refreshing cache from master, [6764ms] too many traces: truncated at 100 traces, deferred=Deferred@1683807042(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@14ef3558 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@469638006 after retry RPC after error@1681862244) -> (continuation of Deferred@1715171178 after retry RPC after error@194233088) -> (continuation of Deferred@1616727215 after retry RPC after error@2106331854) -> (continuation of Deferred@1089561130 after retry RPC after error@1441735415) -> (continuation of Deferred@1608332497 after retry RPC after error@1121605510) -> (continuation of Deferred@166829509 after retry RPC after error@631635606) -> (continuation of Deferred@333983055 after retry RPC after error@60702419) -> (continuation of Deferred@100959440 after retry RPC after error@215981000) -> (continuation of Deferred@1586453833 after retry RPC after error@748001517) -> (continuation of Deferred@244693931 after retry RPC after error@2128896106) -> (continuation of Deferred@1520771050 after retry RPC after error@1517794979) -> (continuation of Deferred@2040268453 after retry RPC after error@606527180) -> (continuation of Deferred@1443811309 after retry RPC after error@833333537) -> (continuation of Deferred@681257119 after retry RPC after error@978932734) -> (continuation of Deferred@436769535 after retry RPC after error@1988543038) -> (continuation of Deferred@120116129 after retry RPC after error@2006885913) -> (continuation of Deferred@702500223 after retry RPC after error@1770581320) -> (continuation of Deferred@687644163 after retry RPC after error@709909355) -> (continuation of Deferred@2033672171 after retry RPC after error@1467682600) -> (continuation of Deferred@465276738 after retry RPC after error@865604701) -> (continuation of Deferred@1880350146 after retry RPC after error@2141101735) -> (continuation of Deferred@941154185 after retry RPC after error@1271991851) -> (continuation of Deferred@633485150 after retry RPC after error@782429927) -> (continuation of Deferred@1345882157 after retry RPC after error@324756567)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.189:34071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:23:51.689 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:23:51.690 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:23:51.690 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
14:23:51.694 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:23:51.694 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:51.694 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:23:51.694 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:51.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
14:23:51.695 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:23:51.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:23:51.695 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:23:51.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
14:23:51.695 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:23:51.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.700 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.701 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state TERMINATED
14:23:51.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] disconnecting while in state TERMINATED
14:23:51.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state TERMINATED
14:23:51.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state TERMINATED
14:23:51.706 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:51.707 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:51.707 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
14:23:51.707 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:23:51.708 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:51.708 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:23:51.708 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:51.709 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state TERMINATED
14:23:51.709 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e2348a0f6cd84dffaa4fa04af9eaf0b9(127.12.11.1:39911)] disconnecting while in state TERMINATED
14:23:51.709 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state TERMINATED
14:23:51.709 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state TERMINATED
14:23:51.710 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:51.710 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:23:51.710 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:51.710 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:23:51.710 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:23:51.710 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:23:51.710 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:51.711 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state TERMINATED
14:23:51.712 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] disconnecting while in state TERMINATED
14:23:51.712 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state TERMINATED
14:23:51.712 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state TERMINATED
14:23:51.712 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:51.712 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:23:51.714 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
14:23:51.714 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:23:51.714 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:51.714 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:23:51.714 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:51.716 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.12.11.61:45967(127.12.11.61:45967)] disconnecting while in state TERMINATED
14:23:51.716 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 43408dde659b44f5a0f27fdd2a5a1f97(127.12.11.3:46811)] disconnecting while in state TERMINATED
14:23:51.716 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.12.11.60:37961(127.12.11.60:37961)] disconnecting while in state TERMINATED
14:23:51.716 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.12.11.62:39875(127.12.11.62:39875)] disconnecting while in state TERMINATED
14:23:51.716 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:51.716 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:23:51.717 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
14:23:51.717 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
14:23:51.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.720 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.720 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.721 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.721 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.722 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
14:23:51.722 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:51.723 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:23:51.723 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:23:51.724 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
14:23:51.724 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:23:51.725 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:51.726 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:23:51.726 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:51.727 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:23:51.727 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:23:51.727 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:23:51.728 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:23:51.728 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:51.734 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:51.734 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:23:51.734 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:23:51.734 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:23:51.735 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
14:23:51.735 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:23:51.735 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:51.738 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.739 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.739 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.739 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.740 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.747 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:23:51.747 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:23:51.748 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:23:51.748 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:23:51.749 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
14:23:51.750 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:23:51.751 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:23:51.758 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.759 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.759 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.759 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.759 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.760 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.778 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.779 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.779 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.779 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.779 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.779 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.779 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.779 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.779 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.780 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.780 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.798 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.798 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.799 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.799 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.799 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.799 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.799 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.800 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.819 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.819 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.820 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.821 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.886785 14911 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.887164 14911 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.887565 14911 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:51.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.917953 14911 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:51.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.918975 14911 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.33.2
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.953958 14911 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.2:0
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data/info.pb
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.2
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.2
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/logs
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:51.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.955410 14911 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:51.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:51.957219 14911 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:51.958 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:51.959 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:51.959 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:51.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:51.959 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.959 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.959 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:51.960 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.960 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:51.960 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:51.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.970778 14940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:52.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:52.045 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:52.045 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:52.047 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:52.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.046 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.048 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.048 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:52.360 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.360 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.360 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.360 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.360 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.360 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.361 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.361 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.367 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:52.367 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:52.367 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:52.367 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.367 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.367 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.368 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.368 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.368 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:52.478 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.11.83.188:44337, [8ms] received response from server master-127.11.83.188:44337: OK, deferred=null) with no deferred attached!
14:23:52.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:52.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:52.570848 14905 heartbeater.cc:499] Master 127.14.33.60:39347 was elected leader, sending a full tablet report...
14:23:52.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:52.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:52.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:52.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:52.630 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.630 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.630 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:52.630 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.630 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.630 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:52.630 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:52.742 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:23:52.744 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:23:52.745 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
14:23:52.745 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:23:52.766 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
14:23:52.767 [INFO - Thread-20] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:23:52.767 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
14:23:52.767 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:23:52.767 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:23:52.767 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:23:52.768 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:23:52.768 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:23:52.768 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:23:52.769 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:23:52.772 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:23:52.773 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:23:52.774 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:23:52.774 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
14:23:52.774 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:23:52.777 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
14:23:52.777 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:23:52.778 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:23:52.778 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:52.779 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:23:52.780 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
14:23:52.780 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
14:23:52.781 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
14:23:52.782 [INFO - Thread-20] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:23:52.782 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:23:52.782 [INFO - Thread-20] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:23:52.783 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
14:23:52.783 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:23:52.785 [DEBUG - Thread-20] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:52.785 [INFO - Thread-20] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:23:52.791 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:23:52.793 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:23:52.795 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
14:23:52.795 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
14:23:52.796 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d468cfc
14:23:52.796 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:52.799 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:23:52.801 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:23:52.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:52.801 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:23:52.801 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:23:52.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:23:52.801 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:23:52.802 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f0784b7
14:23:52.802 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:52.802 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:52.803 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:23:52.803 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:23:52.806 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1daf75f2
14:23:52.809 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5450b66e
14:23:52.811 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:52.813 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:52.813 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:52.813 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:52.813 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:23:52.814 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:23:52.815 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35e0bf7
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@40f8ee1e
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:52.816 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:23:52.817 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:23:52.817 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:23:52.817 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:23:52.818 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:23:52.820 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2601d526
14:23:52.821 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:52.821 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ec29beb
14:23:52.821 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.823 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:52.824 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:52.825 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.826 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.827 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.829 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.829 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.829 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.829 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.829 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.830 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.830 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.831 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.832 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.834 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.834 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.835 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.835 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.835 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.839 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.841 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.841 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.841 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.841 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.842 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.842 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.843 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.843 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.844 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.844 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.846 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.847 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.850 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.850 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.858 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.862 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.862 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.863 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.863 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.863 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.863 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.865 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.865 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.865 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.867 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.867 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.867 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.871 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.871 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.872 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.873 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.875 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.875 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.876 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.876 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.876 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.876 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.877 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.877 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.878 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.882 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.882 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.882 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.882 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.883 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.883 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.883 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.883 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.883 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.883 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.883 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.890 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.890 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.890 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.891 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.891 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.892 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.892 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.892 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.892 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.893 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.894 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.894 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.894 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.895 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.895 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.895 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.896 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.897 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.902 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.902 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.903 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.902 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.903 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.904 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.904 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.904 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.905 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.910 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.910 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.910 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.910 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.911 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.910 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.911 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.911 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.911 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.911 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.912 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.912 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.912 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.912 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.912 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.922 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.922 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.922 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.922 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.922 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.923 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.923 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.923 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.923 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.923 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.923 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.924 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.930 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.930 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.930 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.930 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.931 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.931 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.931 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.931 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.931 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.932 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.933 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.933 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.934 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.934 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.935 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.935 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.935 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.933 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.934 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.936 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.936 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.936 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.950 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:52.950 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.950 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:52.951 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:52.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:52.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.951 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:52.952 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.952 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:52.953 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:52.953 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.953 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.954 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.954 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.954 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.954 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.954 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.954 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.950 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.954 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.955 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.955 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.952 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.955 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.956 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.962 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.962 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.962 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.964 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.964 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.964 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.964 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.971 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.971 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.971 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.974 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:52.992 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:52.992 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:52.993 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:52.993 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.993 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.993 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:52.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.994 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:52.994 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:52.995 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.002 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.002 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.002 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.003 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.003 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.003 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.003 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.003 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.003 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.003 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.003 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.003 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.010 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:53.011 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:53.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.011 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:53.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.011 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.012 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:53.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:53.031 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.031 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.031 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.031 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.032 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.033 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.033 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.033 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.033 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.033 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.034 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.034 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.072 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.073 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.073 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.074 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:53.075 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:53.075 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:53.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.077 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.077 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:53.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.078 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.078 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.078 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.078 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.078 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:53.079 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.079 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.079 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.079 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.079 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.079 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.080 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.081 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.081 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.081 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.081 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.081 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.171 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.171 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.171 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.172 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.172 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.192 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.192 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.193 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.193 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.193 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.194 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.194 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.194 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.194 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.194 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.195 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.283 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.283 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.283 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.285 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.294 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.294 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.294 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.296 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.296 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.296 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.297 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:53.297 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:53.297 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:53.298 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.298 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.298 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.299 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.299 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:53.302 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.302 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.302 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.304 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.322 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.322 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.323 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.323 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.324 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.332 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.332 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.332 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.334 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.490 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.490 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.491 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.491 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:53.374785 14939 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 14911
14:23:53.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:51.971809 14941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:53.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:53.515087 14911 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.546s	user 0.486s	sys 0.978s
14:23:53.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:53.515429 14911 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.546s	user 0.486s	sys 0.978s
14:23:53.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:53.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:53.525336 14999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:53.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.525704 14911 server_base.cc:1061] running on GCE node
14:23:53.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.526842 14911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:53.529 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:53.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.528901 14911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:53.529 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:53.529 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.529 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:53.529 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.529 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.529 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.530 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.530 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:53.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.530342 14911 hybrid_clock.cc:648] HybridClock initialized: now 1779114233530238 us; error 89 us; skew 500 ppm
14:23:53.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.531260 14911 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:53.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.537482 14911 webserver.cc:533] Webserver started at http://127.14.33.2:33725/ using document root <none> and password file <none>
14:23:53.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.538419 14911 fs_manager.cc:362] Metadata directory not provided
14:23:53.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.538707 14911 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:53.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.539183 14911 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:53.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.543929 14911 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data/instance:
14:23:53.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e976224b2c843f9a46ee80b4b2364cf"
14:23:53.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:53 on dist-test-slave-1n46"
14:23:53.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.545230 14911 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal/instance:
14:23:53.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e976224b2c843f9a46ee80b4b2364cf"
14:23:53.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:53 on dist-test-slave-1n46"
14:23:53.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:53.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.553565 14911 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
14:23:53.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.559893 15005 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:53.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.561267 14911 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.561748 14911 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e976224b2c843f9a46ee80b4b2364cf"
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:53 on dist-test-slave-1n46"
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.562206 14911 fs_report.cc:389] FS layout report
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data/data
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:53.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:53.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.613616 14911 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:53.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.615191 14911 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:53.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.615665 14911 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:53.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.618876 14911 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:53.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.623966 14911 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:53.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.624188 14911 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:53.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.624424 14911 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:53.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.624614 14911 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:53.687 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:53.687 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:53.688 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:53.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.689 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:53.691 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.692 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.692 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.692 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.693 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.693 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.693 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.693 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.751 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:53.751 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:53.751 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:53.752 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.752 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.752 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.752 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:53.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:53.753 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:53.753 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.770012 14911 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.2:40223
14:23:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.770119 15117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.2:40223 every 8 connection(s)
14:23:53.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.772405 14911 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/data/info.pb
14:23:53.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.775619 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 14911
14:23:53.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.776060 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-1/wal/instance
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.790325 14468 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/logs
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data/info.pb
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:53.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.3:0
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.3
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.3
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:23:53.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.815435 15118 heartbeater.cc:344] Connected to a master server at 127.14.33.60:39347
14:23:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.816000 15118 heartbeater.cc:461] Registering TS with master...
14:23:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.817603 15118 heartbeater.cc:507] Master 127.14.33.60:39347 requested a full tablet report, sending...
14:23:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.820798 14673 ts_manager.cc:194] Registered new tserver with Master: 6e976224b2c843f9a46ee80b4b2364cf (127.14.33.2:40223)
14:23:53.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.823765 14673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.33.2:60521
14:23:53.832 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.833 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.833 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.833793 15119 heartbeater.cc:344] Connected to a master server at 127.14.33.61:38507
14:23:53.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.834286 15119 heartbeater.cc:461] Registering TS with master...
14:23:53.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.835186 15119 heartbeater.cc:507] Master 127.14.33.61:38507 requested a full tablet report, sending...
14:23:53.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.837 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.837 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.837 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.838 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.838863 14589 ts_manager.cc:194] Registered new tserver with Master: 6e976224b2c843f9a46ee80b4b2364cf (127.14.33.2:40223)
14:23:53.847 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:53.848 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:53.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.848 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:53.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:53.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:53.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:53.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.849174 15122 heartbeater.cc:344] Connected to a master server at 127.14.33.62:33795
14:23:53.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:53.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.849498 15122 heartbeater.cc:461] Registering TS with master...
14:23:53.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.850016 15122 heartbeater.cc:507] Master 127.14.33.62:33795 requested a full tablet report, sending...
14:23:53.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:53.852525 14514 ts_manager.cc:194] Registered new tserver with Master: 6e976224b2c843f9a46ee80b4b2364cf (127.14.33.2:40223)
14:23:53.882 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.883 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.883 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.883 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.883 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.883 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.883 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.883 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.883 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.883 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.883 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:53.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:53.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:53.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:53.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:53.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.933 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.933 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:53.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:53.933 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:54.027 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:54.028 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:54.028 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:54.029 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.029 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.029 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.029 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.029 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:54.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.030 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:54.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.152851 15125 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:23:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.153390 15125 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:23:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.153860 15125 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:23:54.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.186194 15125 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:23:54.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.187002 15125 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.33.3
14:23:54.190 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:54.190 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:54.191 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:54.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:54.222191 15125 tablet_server_runner.cc:78] Tablet server non-default flags:
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.33.20:32887
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.33.3:0
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data/info.pb
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.33.3
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.33.62:33795,127.14.33.61:38507,127.14.33.60:39347
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.33.3
14:23:54.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/logs
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:23:54.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:54.223580 15125 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:23:54.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:54.225095 15125 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:23:54.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.236492 15133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:54.328 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:54.329 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:54.329 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:54.330 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.330 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.330 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:54.330 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.330 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.331 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:54.331 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.331 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.331 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:54.331 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:54.332 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:54.332 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:54.332 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:54.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.334 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:54.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:54.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:54.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:54.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:54.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:54.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:54.352 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:54.352 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:54.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:54.353 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:54.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:54.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:54.353 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:54.422 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:54.422 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:54.423 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:54.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.424 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:54.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:54.549 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:54.806 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:54.807 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:54.807 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:54.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:54.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:54.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:54.811 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:54.811 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:54.811 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:54.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:54.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:54.812 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:54.812 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:54.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:54.829852 15118 heartbeater.cc:499] Master 127.14.33.60:39347 was elected leader, sending a full tablet report...
14:23:54.851 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:54.851 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:54.851 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:54.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:54.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:54.853 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.854 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:54.854 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:55.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:55.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:55.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:55.056797 14111 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad240 after lost signal to thread 13978
14:23:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:55.057847 14111 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9260 after lost signal to thread 14114
14:23:55.249 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:55.249 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:55.250 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:55.250 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.250 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.250 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.250 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.250 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.250 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.250 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.250 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.250 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.250 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:55.519 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:55.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:55.572 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:55.572 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:55.572 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:55.573 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.573 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.573 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.574 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.575 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:55.672 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:55.672 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:55.672 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:55.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:55.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:55.674 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.674 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:55.675 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:55.685 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:55.686 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:55.686 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:55.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:55.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:55.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:55.688 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:56.018 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:56.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:56.093 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:56.093 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:56.094 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:56.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:56.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:56.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:56.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:56.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:56.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:56.095 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:56.095 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:56.095 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:56.095 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:55.640457 15132 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 15125
14:23:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:56.243847 15125 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.007s	user 0.603s	sys 1.032s
14:23:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:56.244697 15136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:56.244793 15125 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.008s	user 0.603s	sys 1.032s
14:23:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.245043 15125 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:23:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:56.244096 15135 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2004 milliseconds
14:23:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:54.237735 15134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:23:56.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.250514 15125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:23:56.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.253389 15125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:23:56.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.254835 15125 hybrid_clock.cc:648] HybridClock initialized: now 1779114236254807 us; error 40 us; skew 500 ppm
14:23:56.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.255873 15125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:23:56.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.265193 15125 webserver.cc:533] Webserver started at http://127.14.33.3:35351/ using document root <none> and password file <none>
14:23:56.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.266378 15125 fs_manager.cc:362] Metadata directory not provided
14:23:56.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.266618 15125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:23:56.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.267143 15125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:23:56.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.273561 15125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data/instance:
14:23:56.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "350754aecef644548b5fded53fc616b3"
14:23:56.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:56 on dist-test-slave-1n46"
14:23:56.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.275020 15125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal/instance:
14:23:56.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "350754aecef644548b5fded53fc616b3"
14:23:56.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:56 on dist-test-slave-1n46"
14:23:56.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.283856 15125 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
14:23:56.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.291137 15149 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:23:56.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.292548 15125 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
14:23:56.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.292913 15125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal
14:23:56.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "350754aecef644548b5fded53fc616b3"
14:23:56.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:23:56 on dist-test-slave-1n46"
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.293301 15125 fs_report.cc:389] FS layout report
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data/data
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:23:56.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:23:56.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.351080 15125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:23:56.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.352605 15125 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:23:56.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.352955 15125 kserver.cc:163] Server-wide thread pool size limit: 3276
14:23:56.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.355981 15125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:23:56.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.360572 15125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:23:56.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.360750 15125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:23:56.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.360936 15125 ts_tablet_manager.cc:616] Registered 0 tablets
14:23:56.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.361106 15125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:23:56.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.533548 15125 rpc_server.cc:307] RPC server started. Bound to: 127.14.33.3:36301
14:23:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.533674 15261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.33.3:36301 every 8 connection(s)
14:23:56.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.537395 15125 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/data/info.pb
14:23:56.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.543260 14468 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 15125
14:23:56.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.543682 14468 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster9562389361757676452/ts-2/wal/instance
14:23:56.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.607625 15262 heartbeater.cc:344] Connected to a master server at 127.14.33.60:39347
14:23:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.608139 15262 heartbeater.cc:461] Registering TS with master...
14:23:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.609427 15262 heartbeater.cc:507] Master 127.14.33.60:39347 requested a full tablet report, sending...
14:23:56.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.615046 14673 ts_manager.cc:194] Registered new tserver with Master: 350754aecef644548b5fded53fc616b3 (127.14.33.3:36301)
14:23:56.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.616788 14673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.33.3:48945
14:23:56.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.629206 15263 heartbeater.cc:344] Connected to a master server at 127.14.33.61:38507
14:23:56.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.629545 15263 heartbeater.cc:461] Registering TS with master...
14:23:56.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.630213 15263 heartbeater.cc:507] Master 127.14.33.61:38507 requested a full tablet report, sending...
14:23:56.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.632691 14589 ts_manager.cc:194] Registered new tserver with Master: 350754aecef644548b5fded53fc616b3 (127.14.33.3:36301)
14:23:56.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.642874 15264 heartbeater.cc:344] Connected to a master server at 127.14.33.62:33795
14:23:56.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.643221 15264 heartbeater.cc:461] Registering TS with master...
14:23:56.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.643817 15264 heartbeater.cc:507] Master 127.14.33.62:33795 requested a full tablet report, sending...
14:23:56.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.646013 14514 ts_manager.cc:194] Registered new tserver with Master: 350754aecef644548b5fded53fc616b3 (127.14.33.3:36301)
14:23:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.650658 14468 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:23:56.665 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:23:56.666 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:23:56.667 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.33.62"
      port: 33795
    }
    bound_http_address {
      host: "127.14.33.62"
      port: 37211
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.33.61"
      port: 38507
    }
    bound_http_address {
      host: "127.14.33.61"
      port: 38985
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.33.60"
      port: 39347
    }
    bound_http_address {
      host: "127.14.33.60"
      port: 36045
    }
  }
}

14:23:56.667 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:23:56.668 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.33.1"
      port: 43269
    }
    bound_http_address {
      host: "127.14.33.1"
      port: 40955
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.33.2"
      port: 40223
    }
    bound_http_address {
      host: "127.14.33.2"
      port: 33725
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.33.3"
      port: 36301
    }
    bound_http_address {
      host: "127.14.33.3"
      port: 35351
    }
  }
}

14:23:56.668 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:23:56.668 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:56.669 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:56.669 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:56.669 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.669 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.669 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.670 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:56.670 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.670 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.670 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.670 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:56.671 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:23:56.672 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:23:56.672 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.91.124:35565(127.13.91.124:35565)] Successfully connected to peer
14:23:56.674 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:23:56.676 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.91.126:39961(127.13.91.126:39961)] Successfully connected to peer
14:23:56.683 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.124
14:23:56.685 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.126
14:23:56.684 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.91.125:45957(127.13.91.125:45957)] Successfully connected to peer
14:23:56.697 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:56.699 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:56.702 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x12694b8b, L:/127.0.0.1:47278 - R:/127.13.91.126:39961] using SASL/PLAIN
14:23:56.704 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x34c76c4b, L:/127.0.0.1:60648 - R:/127.13.91.124:35565] using SASL/PLAIN
14:23:56.710 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:56.710 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=39), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [35ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: OK, deferred=null) after lookup
14:23:56.711 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.125
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.712371 13878 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60648:
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:23:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:56.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:56.717481 13878 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:23:56.722 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:56.731 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x51d9192b, L:/127.0.0.1:32974 - R:/127.13.91.125:45957] using SASL/PLAIN
14:23:56.769 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:23:56.787 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:56.787 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:56.787 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:56.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:56.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:56.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:56.788 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:56.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:56.788 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:56.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:56.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:56.788 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:56.788 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:56.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.857105 14253 tablet_service.cc:1511] Processing CreateTablet for tablet 888589148bf64dc182b4cb8edfba94df (DEFAULT_TABLE table=replication_test_table [id=bcb08a8ae4f54d72bc8242d74994969a]), partition=
14:23:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.859694 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888589148bf64dc182b4cb8edfba94df. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:56.870 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:56.870 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:56.870 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:56.871 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:56.871 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:56.871 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:56.874 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:56.874 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:56.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:56.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:56.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:56.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:56.875 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.872987 14049 tablet_service.cc:1511] Processing CreateTablet for tablet 888589148bf64dc182b4cb8edfba94df (DEFAULT_TABLE table=replication_test_table [id=bcb08a8ae4f54d72bc8242d74994969a]), partition=
14:23:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.876804 14049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888589148bf64dc182b4cb8edfba94df. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:56.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.893793 14393 tablet_service.cc:1511] Processing CreateTablet for tablet 888589148bf64dc182b4cb8edfba94df (DEFAULT_TABLE table=replication_test_table [id=bcb08a8ae4f54d72bc8242d74994969a]), partition=
14:23:56.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.895933 14393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888589148bf64dc182b4cb8edfba94df. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:56.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.897711 15296 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Bootstrap starting.
14:23:56.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.906230 15296 tablet_bootstrap.cc:654] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Neither blocks nor log segments found. Creating new log.
14:23:56.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.908581 15296 log.cc:826] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Log is configured to *not* fsync() on all Append() calls
14:23:56.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.919971 15296 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: No bootstrap required, opened a new log
14:23:56.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.920403 15296 ts_tablet_manager.cc:1403] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.011s
14:23:56.925 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:56.926 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:56.926 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:56.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:56.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:56.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:56.927 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:56.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.930114 15297 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Bootstrap starting.
14:23:56.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.943470 15297 tablet_bootstrap.cc:654] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Neither blocks nor log segments found. Creating new log.
14:23:56.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.947239 15296 raft_consensus.cc:359] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:56.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.948155 15296 raft_consensus.cc:385] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:56.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.948474 15296 raft_consensus.cc:740] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66836e70c3d846479dcde68b865e926f, State: Initialized, Role: FOLLOWER
14:23:56.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.949419 15296 consensus_queue.cc:260] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:56.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.952879 15297 log.cc:826] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Log is configured to *not* fsync() on all Append() calls
14:23:56.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.956243 15296 ts_tablet_manager.cc:1434] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Time spent starting tablet: real 0.036s	user 0.025s	sys 0.011s
14:23:56.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.979305 15299 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Bootstrap starting.
14:23:56.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.986541 15297 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: No bootstrap required, opened a new log
14:23:56.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.987021 15297 ts_tablet_manager.cc:1403] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.012s
14:23:56.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.988220 15299 tablet_bootstrap.cc:654] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Neither blocks nor log segments found. Creating new log.
14:23:56.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:56.990469 15299 log.cc:826] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Log is configured to *not* fsync() on all Append() calls
14:23:57.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.000943 15299 tablet_bootstrap.cc:492] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: No bootstrap required, opened a new log
14:23:57.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.001410 15299 ts_tablet_manager.cc:1403] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.010s
14:23:57.006 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:57.007 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:57.007 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:57.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.007 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.007 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.008 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.008 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.008 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.008 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:57.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:57.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.020949 15297 raft_consensus.cc:359] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.021906 15297 raft_consensus.cc:385] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:57.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.022220 15297 raft_consensus.cc:740] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86923de6e1d45a0bc9ef0df6fae4536, State: Initialized, Role: FOLLOWER
14:23:57.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.023164 15297 consensus_queue.cc:260] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.029325 15299 raft_consensus.cc:359] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.030200 15299 raft_consensus.cc:385] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.030489 15299 raft_consensus.cc:740] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6642d6312be4fc98a209efce2f4539c, State: Initialized, Role: FOLLOWER
14:23:57.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.031517 15299 consensus_queue.cc:260] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.037731 15297 ts_tablet_manager.cc:1434] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Time spent starting tablet: real 0.050s	user 0.029s	sys 0.016s
14:23:57.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:57.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.079141 15299 ts_tablet_manager.cc:1434] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Time spent starting tablet: real 0.077s	user 0.024s	sys 0.014s
14:23:57.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.101524 15300 raft_consensus.cc:493] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:57.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.102170 15300 raft_consensus.cc:515] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.108598 15300 leader_election.cc:290] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86923de6e1d45a0bc9ef0df6fae4536 (127.13.91.65:40523), d6642d6312be4fc98a209efce2f4539c (127.13.91.67:35819)
14:23:57.147 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:57.147 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:57.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.145987 14069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888589148bf64dc182b4cb8edfba94df" candidate_uuid: "66836e70c3d846479dcde68b865e926f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" is_pre_election: true
14:23:57.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.146834 14069 raft_consensus.cc:2468] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66836e70c3d846479dcde68b865e926f in term 0.
14:23:57.147 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:57.148 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.148 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.148 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.148 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.148 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.148 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.148 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.149338 14176 leader_election.cc:304] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66836e70c3d846479dcde68b865e926f, e86923de6e1d45a0bc9ef0df6fae4536; no voters: 
14:23:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.150206 15300 raft_consensus.cc:2804] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.150486 15300 raft_consensus.cc:493] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.150753 15300 raft_consensus.cc:3060] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 0 FOLLOWER]: Advancing to term 1
14:23:57.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:57.157166 14461 tablet.cc:2404] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:57.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.158072 15300 raft_consensus.cc:515] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.160477 14069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888589148bf64dc182b4cb8edfba94df" candidate_uuid: "66836e70c3d846479dcde68b865e926f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86923de6e1d45a0bc9ef0df6fae4536"
14:23:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.160912 14069 raft_consensus.cc:3060] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 0 FOLLOWER]: Advancing to term 1
14:23:57.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.167541 14069 raft_consensus.cc:2468] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66836e70c3d846479dcde68b865e926f in term 1.
14:23:57.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.168134 15300 leader_election.cc:290] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [CANDIDATE]: Term 1 election: Requested vote from peers e86923de6e1d45a0bc9ef0df6fae4536 (127.13.91.65:40523), d6642d6312be4fc98a209efce2f4539c (127.13.91.67:35819)
14:23:57.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.169903 14176 leader_election.cc:304] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66836e70c3d846479dcde68b865e926f, e86923de6e1d45a0bc9ef0df6fae4536; no voters: 
14:23:57.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.170935 15300 raft_consensus.cc:2804] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 1 FOLLOWER]: Leader election won for term 1
14:23:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.174437 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888589148bf64dc182b4cb8edfba94df" candidate_uuid: "66836e70c3d846479dcde68b865e926f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6642d6312be4fc98a209efce2f4539c" is_pre_election: true
14:23:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.175236 14413 raft_consensus.cc:2468] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66836e70c3d846479dcde68b865e926f in term 0.
14:23:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.176613 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888589148bf64dc182b4cb8edfba94df" candidate_uuid: "66836e70c3d846479dcde68b865e926f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6642d6312be4fc98a209efce2f4539c"
14:23:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.177166 14412 raft_consensus.cc:3060] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 0 FOLLOWER]: Advancing to term 1
14:23:57.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.184729 14412 raft_consensus.cc:2468] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66836e70c3d846479dcde68b865e926f in term 1.
14:23:57.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.186110 15300 raft_consensus.cc:697] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [term 1 LEADER]: Becoming Leader. State: Replica: 66836e70c3d846479dcde68b865e926f, State: Running, Role: LEADER
14:23:57.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.188656 15300 consensus_queue.cc:237] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } }
14:23:57.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:57.201414 14325 tablet.cc:2404] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:57.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.216183 13878 catalog_manager.cc:5697] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f reported cstate change: term changed from 0 to 1, leader changed from <none> to 66836e70c3d846479dcde68b865e926f (127.13.91.66). New cstate: current_term: 1 leader_uuid: "66836e70c3d846479dcde68b865e926f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66836e70c3d846479dcde68b865e926f" member_type: VOTER last_known_addr { host: "127.13.91.66" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 } health_report { overall_health: UNKNOWN } } }
14:23:57.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:57.244797 14123 tablet.cc:2404] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:57.287 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:57.287 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:57.287 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:57.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:57.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:57.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:57.288 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:57.318 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:23:57.322 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 888589148bf64dc182b4cb8edfba94df for table 'replication_test_table' with partition [<start>, <end>)
14:23:57.322 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)[L],d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)]}]
14:23:57.322 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.13.91.124:35565, [3ms] Sub RPC GetTableLocations: received response from server master-127.13.91.124:35565: OK, deferred=null) after lookup
14:23:57.322 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)] connecting to peer
14:23:57.323 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)] Successfully connected to peer
14:23:57.336 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.339 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x71493a0f, L:/127.0.0.1:43206 - R:/127.13.91.66:36327] using TOKEN/null
14:23:57.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.352725 14412 raft_consensus.cc:1275] T 888589148bf64dc182b4cb8edfba94df P d6642d6312be4fc98a209efce2f4539c [term 1 FOLLOWER]: Refusing update from remote peer 66836e70c3d846479dcde68b865e926f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:57.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.353245 14069 raft_consensus.cc:1275] T 888589148bf64dc182b4cb8edfba94df P e86923de6e1d45a0bc9ef0df6fae4536 [term 1 FOLLOWER]: Refusing update from remote peer 66836e70c3d846479dcde68b865e926f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:23:57.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.354581 15307 consensus_queue.cc:1048] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6642d6312be4fc98a209efce2f4539c" member_type: VOTER last_known_addr { host: "127.13.91.67" port: 35819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:23:57.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.355336 15300 consensus_queue.cc:1048] T 888589148bf64dc182b4cb8edfba94df P 66836e70c3d846479dcde68b865e926f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86923de6e1d45a0bc9ef0df6fae4536" member_type: VOTER last_known_addr { host: "127.13.91.65" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:23:57.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.393440 15310 mvcc.cc:204] Tried to move back new op lower bound from 7287251916177903616 to 7287251915537235968. Current Snapshot: MvccSnapshot[applied={T|T < 7287251916177903616}]
14:23:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.424530 15311 mvcc.cc:204] Tried to move back new op lower bound from 7287251916177903616 to 7287251915537235968. Current Snapshot: MvccSnapshot[applied={T|T < 7287251916177903616}]
14:23:57.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.433689 15312 mvcc.cc:204] Tried to move back new op lower bound from 7287251916177903616 to 7287251915537235968. Current Snapshot: MvccSnapshot[applied={T|T < 7287251916177903616}]
14:23:57.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:57.544 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:57.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:57.545 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:57.556 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:23:57.556 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:23:57.557 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:23:57.558 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:23:57.559 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:23:57.573 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:23:57.580 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:23:57.596 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.597 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:23:57.598 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.62
14:23:57.607 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x21174711, L:/127.0.0.1:39528 - R:/127.14.33.61:38507] using SASL/PLAIN
14:23:57.607 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.612 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7f3ea44e, L:/127.0.0.1:40636 - R:/127.14.33.60:39347] using SASL/PLAIN
14:23:57.615 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.617 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb719f26f, L:/127.0.0.1:47490 - R:/127.14.33.62:33795] using SASL/PLAIN
14:23:57.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.620520 15262 heartbeater.cc:499] Master 127.14.33.60:39347 was elected leader, sending a full tablet report...
14:23:57.623 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:57.623 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=77), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [57ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:23:57.642 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:23:57.650 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:23:57.663 [DEBUG - main] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:23:57.663 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.91.124:35565(127.13.91.124:35565)] Successfully connected to peer
14:23:57.664 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.91.126:39961(127.13.91.126:39961)] Successfully connected to peer
14:23:57.683 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.91.125:45957(127.13.91.125:45957)] Successfully connected to peer
14:23:57.685 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.126
14:23:57.697 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.702 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xfb00f717, L:/127.0.0.1:47286 - R:/127.13.91.126:39961] using SASL/PLAIN
14:23:57.704 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.125
14:23:57.710 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.124
14:23:57.714 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:57.715 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:57.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.715 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:57.715 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.715 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.715 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.715 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.716 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:57.721 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.726 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6c4ab30d, L:/127.0.0.1:32988 - R:/127.13.91.125:45957] using SASL/PLAIN
14:23:57.733 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:57.737 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4eb07ed6, L:/127.0.0.1:60650 - R:/127.13.91.124:35565] using SASL/PLAIN
14:23:57.742 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:57.742 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=116), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [75ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: OK, [93ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: OK, deferred=null) after lookup
14:23:57.745 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:23:57.749 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 888589148bf64dc182b4cb8edfba94df for table 'replication_test_table' with partition [<start>, <end>)
14:23:57.749 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)[L],d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)]}]
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.753943 14673 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40636:
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:57.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:23:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:57.759310 14673 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:23:57.769 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:57.769 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:57.769 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:57.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.770 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.770 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.770 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.771 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:57.867 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:23:57.927 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:57.928 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:57.928 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:57.929 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.929 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.929 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:57.929 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.929 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:57.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:57.930 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.931540 15197 tablet_service.cc:1511] Processing CreateTablet for tablet bf74b620f4944f62b2a4c4e2d3cc4946 (DEFAULT_TABLE table=replication_test_table [id=499ca3cb479e441e988d54fde3910ba4]), partition=
14:23:57.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:57.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:57.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.932 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:57.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.932880 15197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf74b620f4944f62b2a4c4e2d3cc4946. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:57.933 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.933 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.933 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.933 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.933 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:57.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.973728 15354 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Bootstrap starting.
14:23:57.983 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:57.983 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:57.983 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:57.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.983 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.983 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:57.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:57.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:57.984 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:57.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.990273 15354 tablet_bootstrap.cc:654] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Neither blocks nor log segments found. Creating new log.
14:23:57.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:57.992533 15354 log.cc:826] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Log is configured to *not* fsync() on all Append() calls
14:23:58.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.008731 14839 tablet_service.cc:1511] Processing CreateTablet for tablet bf74b620f4944f62b2a4c4e2d3cc4946 (DEFAULT_TABLE table=replication_test_table [id=499ca3cb479e441e988d54fde3910ba4]), partition=
14:23:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.010242 14839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf74b620f4944f62b2a4c4e2d3cc4946. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:58.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.026865 15354 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: No bootstrap required, opened a new log
14:23:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.028044 15354 ts_tablet_manager.cc:1403] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.020s
14:23:58.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.031070 15053 tablet_service.cc:1511] Processing CreateTablet for tablet bf74b620f4944f62b2a4c4e2d3cc4946 (DEFAULT_TABLE table=replication_test_table [id=499ca3cb479e441e988d54fde3910ba4]), partition=
14:23:58.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.032526 15053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf74b620f4944f62b2a4c4e2d3cc4946. 1 dirs total, 0 dirs full, 0 dirs failed
14:23:58.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.063663 15359 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Bootstrap starting.
14:23:58.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.086427 15359 tablet_bootstrap.cc:654] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Neither blocks nor log segments found. Creating new log.
14:23:58.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.089473 15359 log.cc:826] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Log is configured to *not* fsync() on all Append() calls
14:23:58.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.102800 15354 raft_consensus.cc:359] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.103569 15354 raft_consensus.cc:385] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.103869 15354 raft_consensus.cc:740] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 350754aecef644548b5fded53fc616b3, State: Initialized, Role: FOLLOWER
14:23:58.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.106040 15359 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: No bootstrap required, opened a new log
14:23:58.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.106555 15359 ts_tablet_manager.cc:1403] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.007s
14:23:58.110 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:58.111 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:58.111 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:58.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:58.112 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:58.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:58.112 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:58.112 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:58.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:58.113 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:58.113 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:58.113 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:58.113 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:58.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.115108 15354 consensus_queue.cc:260] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.129527 15362 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Bootstrap starting.
14:23:58.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.138221 15354 ts_tablet_manager.cc:1434] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Time spent starting tablet: real 0.110s	user 0.030s	sys 0.002s
14:23:58.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.149047 15362 tablet_bootstrap.cc:654] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Neither blocks nor log segments found. Creating new log.
14:23:58.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.151456 15362 log.cc:826] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Log is configured to *not* fsync() on all Append() calls
14:23:58.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.168428 15362 tablet_bootstrap.cc:492] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: No bootstrap required, opened a new log
14:23:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.168947 15362 ts_tablet_manager.cc:1403] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.005s
14:23:58.170 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:58.170 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:58.171 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:58.171 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.171 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.171 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.172 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.172 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.172 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:58.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.180867 15359 raft_consensus.cc:359] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.181746 15359 raft_consensus.cc:385] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:58.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.182052 15359 raft_consensus.cc:740] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63d18dedf3764a52adb9e90348858e1b, State: Initialized, Role: FOLLOWER
14:23:58.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.186406 15359 consensus_queue.cc:260] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.199259 15359 ts_tablet_manager.cc:1434] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Time spent starting tablet: real 0.092s	user 0.032s	sys 0.002s
14:23:58.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.214381 15362 raft_consensus.cc:359] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.215306 15362 raft_consensus.cc:385] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:23:58.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.215596 15362 raft_consensus.cc:740] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e976224b2c843f9a46ee80b4b2364cf, State: Initialized, Role: FOLLOWER
14:23:58.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.217103 15362 consensus_queue.cc:260] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.233865 15362 ts_tablet_manager.cc:1434] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Time spent starting tablet: real 0.065s	user 0.038s	sys 0.003s
14:23:58.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.243379 15364 raft_consensus.cc:493] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:23:58.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.243921 15364 raft_consensus.cc:515] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.249032 15364 leader_election.cc:290] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 350754aecef644548b5fded53fc616b3 (127.14.33.3:36301), 6e976224b2c843f9a46ee80b4b2364cf (127.14.33.2:40223)
14:23:58.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:58.256830 14914 tablet.cc:2404] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:58.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.284700 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf74b620f4944f62b2a4c4e2d3cc4946" candidate_uuid: "63d18dedf3764a52adb9e90348858e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350754aecef644548b5fded53fc616b3" is_pre_election: true
14:23:58.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.285616 15217 raft_consensus.cc:2468] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63d18dedf3764a52adb9e90348858e1b in term 0.
14:23:58.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.287228 14795 leader_election.cc:304] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 350754aecef644548b5fded53fc616b3, 63d18dedf3764a52adb9e90348858e1b; no voters: 
14:23:58.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.288097 15364 raft_consensus.cc:2804] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
14:23:58.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.288450 15364 raft_consensus.cc:493] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:23:58.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.288775 15364 raft_consensus.cc:3060] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 0 FOLLOWER]: Advancing to term 1
14:23:58.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.295367 15364 raft_consensus.cc:515] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.295771 15073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf74b620f4944f62b2a4c4e2d3cc4946" candidate_uuid: "63d18dedf3764a52adb9e90348858e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e976224b2c843f9a46ee80b4b2364cf" is_pre_election: true
14:23:58.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.296725 15073 raft_consensus.cc:2468] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63d18dedf3764a52adb9e90348858e1b in term 0.
14:23:58.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.298310 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf74b620f4944f62b2a4c4e2d3cc4946" candidate_uuid: "63d18dedf3764a52adb9e90348858e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350754aecef644548b5fded53fc616b3"
14:23:58.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.298825 15217 raft_consensus.cc:3060] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 0 FOLLOWER]: Advancing to term 1
14:23:58.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.306744 15217 raft_consensus.cc:2468] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63d18dedf3764a52adb9e90348858e1b in term 1.
14:23:58.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.307520 15364 leader_election.cc:290] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [CANDIDATE]: Term 1 election: Requested vote from peers 350754aecef644548b5fded53fc616b3 (127.14.33.3:36301), 6e976224b2c843f9a46ee80b4b2364cf (127.14.33.2:40223)
14:23:58.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.307796 14795 leader_election.cc:304] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 350754aecef644548b5fded53fc616b3, 63d18dedf3764a52adb9e90348858e1b; no voters: 
14:23:58.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.308740 15364 raft_consensus.cc:2804] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 1 FOLLOWER]: Leader election won for term 1
14:23:58.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.308921 15073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf74b620f4944f62b2a4c4e2d3cc4946" candidate_uuid: "63d18dedf3764a52adb9e90348858e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e976224b2c843f9a46ee80b4b2364cf"
14:23:58.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.309458 15073 raft_consensus.cc:3060] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 0 FOLLOWER]: Advancing to term 1
14:23:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.316725 15364 raft_consensus.cc:697] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [term 1 LEADER]: Becoming Leader. State: Replica: 63d18dedf3764a52adb9e90348858e1b, State: Running, Role: LEADER
14:23:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.317305 15073 raft_consensus.cc:2468] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63d18dedf3764a52adb9e90348858e1b in term 1.
14:23:58.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.317674 15364 consensus_queue.cc:237] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } }
14:23:58.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.336493 14673 catalog_manager.cc:5697] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 63d18dedf3764a52adb9e90348858e1b (127.14.33.1). New cstate: current_term: 1 leader_uuid: "63d18dedf3764a52adb9e90348858e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63d18dedf3764a52adb9e90348858e1b" member_type: VOTER last_known_addr { host: "127.14.33.1" port: 43269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 } health_report { overall_health: UNKNOWN } } }
14:23:58.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:58.350376 15126 tablet.cc:2404] T bf74b620f4944f62b2a4c4e2d3cc4946 P 6e976224b2c843f9a46ee80b4b2364cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:58.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:23:58.364724 15269 tablet.cc:2404] T bf74b620f4944f62b2a4c4e2d3cc4946 P 350754aecef644548b5fded53fc616b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:23:58.378 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state READY
14:23:58.378 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state READY
14:23:58.378 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state READY
14:23:58.379 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.91.124:35565(127.13.91.124:35565)] handling channelInactive
14:23:58.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state READY due to: connection closed
14:23:58.379 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:58.381 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
14:23:58.379 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.91.126:39961(127.13.91.126:39961)] handling channelInactive
14:23:58.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state READY due to: connection closed
14:23:58.382 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:23:58.384 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.91.125:45957(127.13.91.125:45957)] handling channelInactive
14:23:58.384 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state READY due to: connection closed
14:23:58.384 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:23:58.384 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state READY
14:23:58.384 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state READY
14:23:58.384 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state READY
14:23:58.384 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:23:58.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:23:58.385 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:23:58.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:23:58.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:23:58.387 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:23:58.388 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:23:58.391 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:23:58.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:23:58.392 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:23:58.394 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:58.394 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:23:58.394 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:23:58.394 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:58.394 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:58.394 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:23:58.401 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:23:58.402 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:23:58.518 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:58.527 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:58.527 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:58.527 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:58.528 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.528 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.528 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.528 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.528 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.528 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.528 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.528 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.528 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.528 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:58.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:58.546 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:58.547 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:58.547 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:58.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.547 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.547 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.547 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.548 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.548 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:58.653 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:23:58.707 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:23:58.707 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:23:58.707 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:23:58.737 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:23:58.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.741683 15364 consensus_queue.cc:1048] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e976224b2c843f9a46ee80b4b2364cf" member_type: VOTER last_known_addr { host: "127.14.33.2" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:23:58.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:23:58.773698 15368 consensus_queue.cc:1048] T bf74b620f4944f62b2a4c4e2d3cc4946 P 63d18dedf3764a52adb9e90348858e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "350754aecef644548b5fded53fc616b3" member_type: VOTER last_known_addr { host: "127.14.33.3" port: 36301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:23:58.786 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:23:58.787 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:23:58.787 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:23:58.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.787 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.787 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:23:58.787 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:23:58.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:23:58.788 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:23:58.827 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:23:58.827 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:23:58.827 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:23:58.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:23:58.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:23:58.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.828 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:23:58.828 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:23:58.972 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:58.973 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:58.973 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:58.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:58.973 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.973 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.973 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:58.973 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.973 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:58.973 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:59.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:59.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:59.507 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
14:23:59.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:59.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:23:59.662 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:23:59.680 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:23:59.701 [INFO - flink-metrics-4] (Slf4jLogger.scala:117) Slf4jLogger started
14:23:59.714 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:23:59.722 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:59.722 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:59.723 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:59.723 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.723 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.723 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.723 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.723 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.724 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.724 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:59.727 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:23:59.732 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:23:59.733 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:23:59.733 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:23:59.733 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:23:59.734 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:23:59.734 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:23:59.734 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:23:59.734 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:23:59.734 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:23:59.735 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:23:59.735 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:23:59.735 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:23:59.735 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:23:59.735 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:23:59.735 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:23:59.735 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:23:59.735 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:23:59.735 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:23:59.735 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:23:59.736 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:23:59.736 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:23:59.736 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:23:59.736 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:23:59.736 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:23:59.736 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_0e46e077d2b4acc74ba77ba5f9a3f997/blobStorage
14:23:59.737 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:37215 - max concurrent requests: 50 - max backlog: 1000
14:23:59.737 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_0e46e077d2b4acc74ba77ba5f9a3f997/blobStorage
14:23:59.738 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_0e46e077d2b4acc74ba77ba5f9a3f997/blobStorage
14:23:59.738 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:23:59.739 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 21691bb2-e877-4288-9642-b4c1288bf103
14:23:59.740 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
14:23:59.741 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-073fec32-eb83-4e4d-9f39-4f5dc1bd6b80
14:23:59.742 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-bb1e0ca9-2b2c-45c7-962f-f246d375ef4a
14:23:59.770 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:23:59.771 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:23:59.771 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:23:59.771 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.771 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:23:59.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:23:59.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:23:59.772 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:23:59.817 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:23:59.818 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:23:59.818 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:23:59.818 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:23:59.819 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:23:59.821 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_8 .
14:23:59.827 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
14:23:59.827 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-acb7f50f-8138-432c-9b15-29968809f67b
14:23:59.829 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:23:59.830 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:23:59.838 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:23:59.838 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:23:59.843 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:35863
14:23:59.843 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:23:59.845 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:23:59.845 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:35863 was granted leadership with leaderSessionID=9dc25120-8ef0-4547-b7f0-14e854eb773d
14:23:59.845 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:35863 , session=9dc25120-8ef0-4547-b7f0-14e854eb773d
14:23:59.846 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:23:59.846 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:23:59.846 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id bff05466-d791-4483-9e68-31612304e41e. Creating new DispatcherLeaderProcess.
14:23:59.846 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:23:59.846 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:23:59.846 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:23:59.846 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:23:59.848 [INFO - pool-129-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id ee3c415d-02d9-4d73-8c8a-96081c61cc01.
14:23:59.848 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_9 .
14:23:59.851 [INFO - pool-129-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_10 .
14:23:59.854 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_9 , session=bff05466-d791-4483-9e68-31612304e41e
14:23:59.855 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
14:23:59.856 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:23:59.856 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:23:59.856 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:23:59.856 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:23:59.856 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_10 , session=ee3c415d-02d9-4d73-8c8a-96081c61cc01
14:23:59.857 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(8c8a96081c61cc01ee3c415d02d94d73).
14:23:59.885 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:23:59.892 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (77d052e6e51b5ae35525074f80512696).
14:23:59.892 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (77d052e6e51b5ae35525074f80512696).
14:23:59.892 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-77d052e6e51b5ae35525074f80512696'.
14:23:59.893 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 77d052e6e51b5ae35525074f80512696 was granted leadership with leader id d9ef1d7e-82b5-45bf-8c84-49fc710e207f. Creating new JobMasterServiceProcess.
14:23:59.894 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1080) Registering TaskManager with ResourceID 21691bb2-e877-4288-9642-b4c1288bf103 (pekko://flink/user/rpc/taskmanager_8) at ResourceManager
14:23:59.895 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_10 under registration id 8b25f5e7a43ead889b51462e74ba879a.
14:23:59.896 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor 21691bb2-e877-4288-9642-b4c1288bf103 under 8b25f5e7a43ead889b51462e74ba879a at the slot manager.
14:23:59.897 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_11 .
14:23:59.902 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (77d052e6e51b5ae35525074f80512696).
14:23:59.902 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (77d052e6e51b5ae35525074f80512696).
14:23:59.903 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph cbc4c8bc6af3ce5fc73a888f368571e5 for job 77d052e6e51b5ae35525074f80512696.
14:23:59.903 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (77d052e6e51b5ae35525074f80512696).
14:23:59.903 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:23:59.904 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:23:59.904 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b86a2a5
14:23:59.905 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:23:59.905 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:23:59.906 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:23:59.906 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@62360d64 for Flink Streaming Job (77d052e6e51b5ae35525074f80512696).
14:23:59.907 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_11 , session=d9ef1d7e-82b5-45bf-8c84-49fc710e207f
14:23:59.908 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (77d052e6e51b5ae35525074f80512696) under job master id 8c8449fc710e207fd9ef1d7e82b545bf.
14:23:59.908 [INFO - flink-pekko.actor.default-dispatcher-4] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:23:59.910 [DEBUG - flink-pekko.actor.default-dispatcher-4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:23:59.910 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:23:59.910 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state CREATED to RUNNING.
14:23:59.911 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:23:59.911 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:23:59.912 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:23:59.912 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:23:59.913 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(8c8a96081c61cc01ee3c415d02d94d73)
14:23:59.914 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:23:59.914 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 8c8449fc710e207fd9ef1d7e82b545bf@pekko://flink/user/rpc/jobmanager_11 for job 77d052e6e51b5ae35525074f80512696.
14:23:59.914 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:23:59.915 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:23:59.915 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:23:59.918 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager 8c8449fc710e207fd9ef1d7e82b545bf@pekko://flink/user/rpc/jobmanager_11 for job 77d052e6e51b5ae35525074f80512696.
14:23:59.920 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.91.126:39961(127.13.91.126:39961)] Successfully connected to peer
14:23:59.930 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:23:59.930 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:23:59.930 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:23:59.931 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:59.931 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:59.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:59.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:59.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:23:59.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:59.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:59.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:23:59.931 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:23:59.931 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:23:59.932 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.91.124:35565(127.13.91.124:35565)] Successfully connected to peer
14:23:59.934 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.91.125:45957(127.13.91.125:45957)] Successfully connected to peer
14:23:59.939 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.125
14:23:59.942 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.124
14:23:59.943 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.126
14:23:59.944 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 8c8a96081c61cc01ee3c415d02d94d73.
14:23:59.944 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:23:59.951 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:59.952 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:23:59.953 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:59.955 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:23:59.956 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:23:59.956 [DEBUG - main] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:23:59.957 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:23:59.958 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd0005fbb, L:/127.0.0.1:33500 - R:/127.13.91.124:35565] using SASL/PLAIN
14:23:59.958 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfbcd3fed, L:/127.0.0.1:58044 - R:/127.13.91.125:45957] using SASL/PLAIN
14:23:59.964 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:23:59.964 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=50), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: OK, deferred=null) after lookup
14:23:59.966 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8ef18709, L:/127.0.0.1:48038 - R:/127.13.91.126:39961] using SASL/PLAIN
14:23:59.967 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:23:59.968 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 77d052e6e51b5ae35525074f80512696
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 21691bb2-e877-4288-9642-b4c1288bf103
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:23:59.969 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot cb555096141ea039362313f4d0c0e292 from 21691bb2-e877-4288-9642-b4c1288bf103 for job 77d052e6e51b5ae35525074f80512696 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.969 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c60b799928fc74d0a31957405e41241b from 21691bb2-e877-4288-9642-b4c1288bf103 for job 77d052e6e51b5ae35525074f80512696 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.969 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request cb555096141ea039362313f4d0c0e292 for job 77d052e6e51b5ae35525074f80512696 from resource manager with leader id 8c8a96081c61cc01ee3c415d02d94d73.
14:23:59.969 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for cb555096141ea039362313f4d0c0e292 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.970 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 286cf6c9ecd3147ec1f81cc1b5086f31 from 21691bb2-e877-4288-9642-b4c1288bf103 for job 77d052e6e51b5ae35525074f80512696 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.970 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot ac09fd07ba20b4a0c2514eaa59e5c2a0 from 21691bb2-e877-4288-9642-b4c1288bf103 for job 77d052e6e51b5ae35525074f80512696 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.971 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:23:59.976 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 888589148bf64dc182b4cb8edfba94df for table 'replication_test_table' with partition [<start>, <end>)
14:23:59.976 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)[L],d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)]}]
14:23:59.976 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:23:59.978 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:23:59.978 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 77d052e6e51b5ae35525074f80512696 for job leader monitoring.
14:23:59.978 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_11 with leader id d9ef1d7e-82b5-45bf-8c84-49fc710e207f.
14:23:59.979 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:23:59.980 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request c60b799928fc74d0a31957405e41241b for job 77d052e6e51b5ae35525074f80512696 from resource manager with leader id 8c8a96081c61cc01ee3c415d02d94d73.
14:23:59.980 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for c60b799928fc74d0a31957405e41241b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.980 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 286cf6c9ecd3147ec1f81cc1b5086f31 for job 77d052e6e51b5ae35525074f80512696 from resource manager with leader id 8c8a96081c61cc01ee3c415d02d94d73.
14:23:59.980 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 286cf6c9ecd3147ec1f81cc1b5086f31 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.981 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request ac09fd07ba20b4a0c2514eaa59e5c2a0 for job 77d052e6e51b5ae35525074f80512696 from resource manager with leader id 8c8a96081c61cc01ee3c415d02d94d73.
14:23:59.981 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for ac09fd07ba20b4a0c2514eaa59e5c2a0 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:23:59.981 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:23:59.983 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_11 for job 77d052e6e51b5ae35525074f80512696.
14:23:59.983 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 77d052e6e51b5ae35525074f80512696.
14:23:59.983 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 77d052e6e51b5ae35525074f80512696.
14:23:59.984 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:23:59.984 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:23:59.985 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:23:59.985 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:23:59.985 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:23:59.986 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:23:59.986 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:23:59.986 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 77d052e6e51b5ae35525074f80512696.
14:23:59.986 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:23:59.986 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 77d052e6e51b5ae35525074f80512696
14:23:59.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:23:59.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:23:59.990 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:23:59.994 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.001 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:24:00.004 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.62
14:24:00.008 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:24:00.009 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:24:00.009 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:24:00.009 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a193372
14:24:00.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:00.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:00.015 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xec6e671a, L:/127.0.0.1:32870 - R:/127.14.33.61:38507] using SASL/PLAIN
14:24:00.016 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x62254cbc, L:/127.0.0.1:43468 - R:/127.14.33.60:39347] using SASL/PLAIN
14:24:00.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:00.018 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:24:00.018 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:24:00.023 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:24:00.024 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:24:00.024 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:24:00.026 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:00.027 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=76), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [69ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:24:00.029 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:24:00.030 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.031 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54d2915c
14:24:00.031 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:00.031 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:00.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:24:00.035 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:24:00.036 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.037 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.037 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.33.60:39347, [6ms] Sub RPC GetTableLocations: received response from server master-127.14.33.60:39347: OK, deferred=null)) after lookup
14:24:00.038 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] connecting to peer
14:24:00.039 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.043 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1be42d1d, L:/127.0.0.1:51462 - R:/127.14.33.62:33795] using SASL/PLAIN
14:24:00.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:00.050 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@33f9b2f3
14:24:00.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:24:00.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:24:00.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:24:00.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:24:00.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:24:00.055 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:24:00.058 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:24:00.058 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:24:00.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7305f5d4
14:24:00.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:00.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:00.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:24:00.059 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:24:00.062 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e6acb0e
14:24:00.069 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:00.069 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:00.069 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:00.069 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.069 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.069 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.070 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:00.082 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:00.086 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:00.092 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@56c132d2
14:24:00.094 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:24:00.095 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:24:00.095 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@70c2f304
14:24:00.095 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:00.095 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:00.096 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:24:00.096 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:24:00.105 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13b174d6
14:24:00.154 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:00.156 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:00.107 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] Successfully connected to peer
14:24:00.154 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:00.157 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:00.158 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:00.161 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:24:00.162 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:00.163 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:00.164 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:24:00.167 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:24:00.174 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.179 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:00.180 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.185 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9daa01fb, L:/127.0.0.1:59430 - R:/127.14.33.1:43269] using TOKEN/null
14:24:00.187 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeb9f87f1, L:/127.0.0.1:32878 - R:/127.14.33.61:38507] using SASL/PLAIN
14:24:00.187 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:24:00.188 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:00.189 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:00.189 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:00.190 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:24:00.192 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:24:00.194 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:24:00.201 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:24:00.204 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.205 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:24:00.206 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.209 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x61b7c069, L:/127.0.0.1:32894 - R:/127.14.33.61:38507] using SASL/PLAIN
14:24:00.211 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xfdaa31d4, L:/127.0.0.1:43480 - R:/127.14.33.60:39347] using SASL/PLAIN
14:24:00.215 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:24:00.218 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.62
14:24:00.219 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:00.219 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=128), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [57ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:24:00.221 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.221 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.222 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:24:00.225 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x99251bde, L:/127.0.0.1:32902 - R:/127.14.33.61:38507] using SASL/PLAIN
14:24:00.225 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.234 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.234 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50efdba7
14:24:00.235 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:00.239 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:24:00.239 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:24:00.241 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.33.61:38507(127.14.33.61:38507)] Successfully connected to peer
14:24:00.244 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.245 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.265 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.61
14:24:00.266 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb75fc065, L:/127.0.0.1:43486 - R:/127.14.33.60:39347] using SASL/PLAIN
14:24:00.266 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:00.268 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:24:00.268 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:24:00.269 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:00.274 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf5058a49, L:/127.0.0.1:51472 - R:/127.14.33.62:33795] using SASL/PLAIN
14:24:00.275 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.279 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.62
14:24:00.280 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:24:00.281 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cb23929624d187e4af4128f632a00acfc5a28ec835a7002fc7cf44a3079ebc3f'}]
14:24:00.282 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.282 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:00.283 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:00.283 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=197), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [72ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:24:00.284 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:24:00.288 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:00.288 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327),d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)[L]]}]
14:24:00.290 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.293 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.294 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28272925
14:24:00.294 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.33.60:39347(127.14.33.60:39347)] Successfully connected to peer
14:24:00.294 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf636e12b, L:/127.0.0.1:32906 - R:/127.14.33.61:38507] using SASL/PLAIN
14:24:00.298 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.33.60
14:24:00.301 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.303 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1397c953, L:/127.0.0.1:43494 - R:/127.14.33.60:39347] using SASL/PLAIN
14:24:00.307 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.312 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.313 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7aa2440d, L:/127.0.0.1:51478 - R:/127.14.33.62:33795] using SASL/PLAIN
14:24:00.315 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:24:00.316 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:00.316 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:24:00.316 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:24:00.317 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:00.317 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=158), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [110ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [119ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:24:00.319 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x187c1911, L:/127.0.0.1:43506 - R:/127.14.33.60:39347] using SASL/PLAIN
14:24:00.322 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.326 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.326 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6688f919
14:24:00.327 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:24:00.327 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:24:00.328 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:24:00.329 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:00.329 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=173), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: OK, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: OK, deferred=null) after lookup
14:24:00.330 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.33.62:33795(127.14.33.62:33795)] Successfully connected to peer
14:24:00.331 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] connecting to peer
14:24:00.332 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:24:00.336 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] Successfully connected to peer
14:24:00.337 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.341 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:00.350 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46c8899
14:24:00.356 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:24:00.357 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:24:00.358 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.65
14:24:00.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:24:00.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:24:00.358 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:24:00.359 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:24:00.360 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:24:00.363 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.365 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.365 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x32c3215d, L:/127.0.0.1:51492 - R:/127.14.33.62:33795] using TOKEN/null
14:24:00.373 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x03987c1e, L:/127.0.0.1:34176 - R:/127.13.91.65:40523] using SASL/PLAIN
14:24:00.380 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.387 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x63bb82df, L:/127.0.0.1:51506 - R:/127.14.33.62:33795] using TOKEN/null
14:24:00.394 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7287251926687744001) for scanner KuduScanner(table=replication_test_table, tablet=888589148bf64dc182b4cb8edfba94df, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.394 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [cb23929624d187e4af4128f632a00acfc5a28ec835a7002fc7cf44a3079ebc3f]
14:24:00.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:24:00.401 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.404 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cb23929624d187e4af4128f632a00acfc5a28ec835a7002fc7cf44a3079ebc3f]
14:24:00.405 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:00.405 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:00.405 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] disconnecting while in state READY
14:24:00.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:00.411 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cb23929624d187e4af4128f632a00acfc5a28ec835a7002fc7cf44a3079ebc3f finished by subtask 0; deferring removal (restored in pending)
14:24:00.411 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:00.412 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:00.412 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:00.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:00.416 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.416 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.416 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.416 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.417 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.417 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.417 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.417 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.418 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.418 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.418 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.418 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.422 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.422 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.422 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bf74b620f4944f62b2a4c4e2d3cc4946 for table 'replication_test_table' with partition [<start>, <end>)
14:24:00.422 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bf74b620f4944f62b2a4c4e2d3cc4946@[350754aecef644548b5fded53fc616b3(127.14.33.3:36301),63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)[L],6e976224b2c843f9a46ee80b4b2364cf(127.14.33.2:40223)]}]
14:24:00.423 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] handling channelInactive
14:24:00.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] cleaning up while in state READY due to: connection closed
14:24:00.423 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:00.423 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:00.464 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:00.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:00.578 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:00.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:00.628 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:00.629 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.630 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.630 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.630 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.630 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.630 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:00.642 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.698 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.725 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:00.726 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:00.726 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:00.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.726 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:00.726 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.727 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:00.727 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.727 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.727 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:00.727 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:00.755 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114240806 for job 77d052e6e51b5ae35525074f80512696.
14:24:00.815 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=504, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@721e114e, flushNotification=Deferred@972048102(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:24:00.816 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] connecting to peer
14:24:00.823 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.828 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] Successfully connected to peer
14:24:00.850 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:00.850 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:00.851 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:00.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:00.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:00.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:00.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:00.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:00.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:00.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:00.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:00.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:00.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:00.852 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:00.856 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8e11e748, L:/127.0.0.1:59438 - R:/127.14.33.1:43269] using TOKEN/null
14:24:00.882 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.912 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:00.912 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:00.912 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:00.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:00.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:00.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:00.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:00.913 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:00.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:00.913 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:00.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:00.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:00.913 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:00.941 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:00.980 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 77d052e6e51b5ae35525074f80512696 (1581 bytes, checkpointDuration=174 ms, finalizationTime=0 ms).
14:24:00.982 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:24:00.982 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split cb23929624d187e4af4128f632a00acfc5a28ec835a7002fc7cf44a3079ebc3f from pending
14:24:00.982 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
14:24:00.986 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:00.986 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:00.986 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:00.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:00.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:00.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:00.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:00.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:00.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:00.987 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:00.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:00.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:00.987 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:01.000 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:01.004 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:24:01.007 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:01.010 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:24:01.015 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:01.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:01.018 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:24:01.023 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 499ca3cb479e441e988d54fde3910ba4
14:24:01.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:01.055 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=888589148bf64dc182b4cb8edfba94df, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:01.063 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:01.116 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=888589148bf64dc182b4cb8edfba94df, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:01.127 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf74b620f4944f62b2a4c4e2d3cc4946, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:01.129 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state READY
14:24:01.129 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state READY
14:24:01.129 [DEBUG - main] (Connection.java:575) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] disconnecting while in state READY
14:24:01.129 [DEBUG - main] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state READY
14:24:01.129 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:24:01.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:24:01.129 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:24:01.130 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:24:01.133 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:24:01.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:24:01.135 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:01.136 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:01.136 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
14:24:01.137 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
14:24:01.146 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] handling channelInactive
14:24:01.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] cleaning up while in state READY due to: connection closed
14:24:01.146 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:24:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.147095 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14772
14:24:01.152 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:01.152 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:01.152 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:01.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.153 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.153 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.153 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.153 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:01.188 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] handling channelInactive
14:24:01.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] cleaning up while in state READY due to: connection closed
14:24:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.190848 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14911
14:24:01.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.238384 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 15125
14:24:01.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.278467 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14480
14:24:01.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114241306 for job 77d052e6e51b5ae35525074f80512696.
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:24:01.320 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.33.62:33795(127.14.33.62:33795)] handling channelInactive
14:24:01.321 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:24:01.321 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state READY due to: connection closed
14:24:01.326 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
14:24:01.327 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:24:01.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.333413 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14551
14:24:01.342 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:01.343 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:01.343 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:01.343 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.343 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.343 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.343 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.343 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.343 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.343 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:01.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:01.373909 14658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.33.62:33795: connect: Connection refused (error 111)
14:24:01.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:01.383940 14658 consensus_peers.cc:597] T 00000000000000000000000000000000 P 44a083cc60134524a6d64ddf0b9ee532 -> Peer f4cab96c685c4378b215e0fe8a48b823 (127.14.33.62:33795): Couldn't send request to peer f4cab96c685c4378b215e0fe8a48b823. Status: Network error: Client connection negotiation failed: client connection to 127.14.33.62:33795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:24:01.385 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:24:01.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:24:01.387 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:24:01.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:24:01.387 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:24:01.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:24:01.387 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.33.61:38507(127.14.33.61:38507)] handling channelInactive
14:24:01.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state READY due to: connection closed
14:24:01.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:01.388327 14468 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14627
14:24:01.398 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:01.398 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:01.398 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:01.398 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.399 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.399 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.399 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.399 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:01.399 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:01.399 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.399 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.399 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:01.399 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:01.450 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:24:01.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:24:01.450 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:24:01.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:24:01.459 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:24:01.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:24:01.459 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.33.60:39347(127.14.33.60:39347)] handling channelInactive
14:24:01.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state READY due to: connection closed
14:24:01.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:01.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:01.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:01.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:01.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:01.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:01.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:01.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:01.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:01.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:01.648 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:01.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:01.648 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:01.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:01.648 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:01.688 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:01.689 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:01.689 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:01.690 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:01.690 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:01.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:01.690 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:01.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:01.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:01.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:01.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:01.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:01.691 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:01.808 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114241806 for job 77d052e6e51b5ae35525074f80512696.
14:24:01.833 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
14:24:01.835 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:24:01.916 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:24:01.922 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fd8befeb05794d60b1a459cecdaaaf504ab082aa0d1373554accb55f4cf28d03'}]
14:24:01.925 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:01.934 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:01.937 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298058, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327),d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)[L]]}]
14:24:01.958 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] connecting to peer
14:24:01.968 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] Successfully connected to peer
14:24:01.990 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.65
14:24:02.008 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:02.012 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x21d1bec3, L:/127.0.0.1:34190 - R:/127.13.91.65:40523] using SASL/PLAIN
14:24:02.019 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:02.047 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:02.086 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:02.086 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:02.087 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.087 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.087 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.087 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.087 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:02.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.088 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:02.149 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:02.149 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:02.149 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:02.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.151 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.151 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:02.308 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114242306 for job 77d052e6e51b5ae35525074f80512696.
14:24:02.326 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:02.327 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:02.327 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.328 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.328 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:02.328 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:02.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.328 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.328 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:02.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:02.329 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:02.329 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 77d052e6e51b5ae35525074f80512696 (1591 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
14:24:02.331 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:24:02.361 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251934867456001) for scanner KuduScanner(table=replication_test_table, tablet=888589148bf64dc182b4cb8edfba94df, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:02.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [fd8befeb05794d60b1a459cecdaaaf504ab082aa0d1373554accb55f4cf28d03]
14:24:02.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fd8befeb05794d60b1a459cecdaaaf504ab082aa0d1373554accb55f4cf28d03]
14:24:02.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:02.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:02.362 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] disconnecting while in state READY
14:24:02.363 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fd8befeb05794d60b1a459cecdaaaf504ab082aa0d1373554accb55f4cf28d03 finished by subtask 1; deferring removal (restored in pending)
14:24:02.364 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:02.374 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] handling channelInactive
14:24:02.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] cleaning up while in state READY due to: connection closed
14:24:02.374 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:02.375 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:02.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:02.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:02.550 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:02.551 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:02.551 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:02.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.552 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.552 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:02.690 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:02.691 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:02.691 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:02.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:02.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.692 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:02.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:02.692 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:02.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114242807 for job 77d052e6e51b5ae35525074f80512696.
14:24:02.824 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 77d052e6e51b5ae35525074f80512696 (1591 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:24:02.826 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:24:02.826 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split fd8befeb05794d60b1a459cecdaaaf504ab082aa0d1373554accb55f4cf28d03 from pending
14:24:02.826 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
14:24:02.871 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:02.871 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:02.871 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:02.871 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:02.871 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:02.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:02.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:02.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:02.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:02.871 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:02.872 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:02.872 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:02.872 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:03.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:03.027 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:03.027 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:03.027 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:03.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:03.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:03.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:03.029 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:03.029 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:03.029 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:03.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:03.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:03.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:03.030 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:03.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:03.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:03Z chronyd exiting
14:24:03.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114243306 for job 77d052e6e51b5ae35525074f80512696.
14:24:03.316 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:03.316 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:03.316 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:03.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.317 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.317 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.317 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.317 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:03.322 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:24:03.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:24:03.328 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:03.329 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:03.329 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:03.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.330 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.331 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:03.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:03.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:03.609 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:03.609 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:03.609 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:03.610 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.610 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.610 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.610 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.610 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.610 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.610 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.610 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.610 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:03.665 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:03.666 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:03.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.666 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:03.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.667 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:03.787 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:03.788 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:03.788 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:03.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:03.806 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114243806 for job 77d052e6e51b5ae35525074f80512696.
14:24:03.816 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:24:03.817 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:24:03.915 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bcb08a8ae4f54d72bc8242d74994969a
14:24:03.917 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='48aa98935b03db008214924473face7030eb683c5c7cbd6fbb793728fedd604f'}]
14:24:03.919 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:03.925 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:03.926 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296059, tablet=888589148bf64dc182b4cb8edfba94df@[66836e70c3d846479dcde68b865e926f(127.13.91.66:36327),d6642d6312be4fc98a209efce2f4539c(127.13.91.67:35819),e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)[L]]}]
14:24:03.927 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] connecting to peer
14:24:03.930 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] Successfully connected to peer
14:24:03.934 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.91.65
14:24:03.944 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:03.946 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:03.946 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:03.946 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:03.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.946 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.946 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:03.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:03.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:03.947 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:03.951 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:03.951 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:03.951 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:03.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.952 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:03.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:03.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:03.952 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:03.956 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x72b45857, L:/127.0.0.1:34194 - R:/127.13.91.65:40523] using SASL/PLAIN
14:24:04.004 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287251943059456001) for scanner KuduScanner(table=replication_test_table, tablet=888589148bf64dc182b4cb8edfba94df, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:04.005 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [48aa98935b03db008214924473face7030eb683c5c7cbd6fbb793728fedd604f]
14:24:04.005 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [48aa98935b03db008214924473face7030eb683c5c7cbd6fbb793728fedd604f]
14:24:04.005 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:04.005 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:04.006 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] disconnecting while in state READY
14:24:04.006 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 48aa98935b03db008214924473face7030eb683c5c7cbd6fbb793728fedd604f finished by subtask 2; deferring removal (restored in pending)
14:24:04.007 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:04.009 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] handling channelInactive
14:24:04.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e86923de6e1d45a0bc9ef0df6fae4536(127.13.91.65:40523)] cleaning up while in state READY due to: connection closed
14:24:04.009 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:24:04.010 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:04.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:04.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:04.115 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state READY
14:24:04.115 [DEBUG - main] (Connection.java:575) [peer 66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)] disconnecting while in state READY
14:24:04.115 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state READY
14:24:04.115 [DEBUG - main] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state READY
14:24:04.116 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.91.124:35565(127.13.91.124:35565)] handling channelInactive
14:24:04.116 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)] handling channelInactive
14:24:04.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state READY due to: connection closed
14:24:04.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 66836e70c3d846479dcde68b865e926f(127.13.91.66:36327)] cleaning up while in state READY due to: connection closed
14:24:04.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:04.116 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.91.125:45957(127.13.91.125:45957)] handling channelInactive
14:24:04.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state READY due to: connection closed
14:24:04.118 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:24:04.118 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:24:04.119 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 29 thread-local buffer(s) from thread: kudu-nio-0
14:24:04.120 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.91.126:39961(127.13.91.126:39961)] handling channelInactive
14:24:04.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state READY due to: connection closed
14:24:04.120 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:24:04.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.121079 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 13958
14:24:04.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.155462 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14122
14:24:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.184900 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 14328
14:24:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.211560 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 13689
14:24:04.228 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:04.228 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:04.228 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:04.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.229 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.229 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.229 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.229 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.229 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:04.239 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.91.126:39961(127.13.91.126:39961)] handling channelInactive
14:24:04.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state READY due to: connection closed
14:24:04.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.240442 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 13760
14:24:04.271 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.91.125:45957(127.13.91.125:45957)] handling channelInactive
14:24:04.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state READY due to: connection closed
14:24:04.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:04.271631 13677 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 13836
14:24:04.299 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.91.124:35565(127.13.91.124:35565)] handling channelInactive
14:24:04.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state READY due to: connection closed
14:24:04.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114244306 for job 77d052e6e51b5ae35525074f80512696.
14:24:04.314 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 77d052e6e51b5ae35525074f80512696 (1591 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:04.315 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:24:04.315 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 48aa98935b03db008214924473face7030eb683c5c7cbd6fbb793728fedd604f from pending
14:24:04.315 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 1 finished splits from enumerator state
14:24:04.348 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:04.349 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:04.349 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:04.349 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.349 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.349 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.350 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.350 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:04.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:04.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:04.682 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:04.683 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:04.683 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:04.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:04.683 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:04.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:04.683 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:04.683 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:04.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:04.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:04.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:04.684 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:04.684 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:04.685 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:04.685 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:04.686 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:04.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:04.686 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:04.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:04.686 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:04.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114244806 for job 77d052e6e51b5ae35525074f80512696.
14:24:04.816 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:24:04.817 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:24:05.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:05.031 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:05.031 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:05.031 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:05.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:05.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:05.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:05.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:05.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:05.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:05.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:05.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:05.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:05.032 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:05.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:05.071 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:05.072 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:05.072 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:05.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.072 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.072 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.072 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.072 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.072 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.073 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:05.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114245306 for job 77d052e6e51b5ae35525074f80512696.
14:24:05.314 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:05.315 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:24:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:05Z chronyd exiting
14:24:05.407 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.407 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.407 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.407 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.408 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.409 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [17ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [18ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [45ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [49ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [83ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [103ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [203ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [203ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [422ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [822ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1563ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3461ms] too many traces: truncated at 100 traces, deferred=Deferred@85329645(state=PENDING, result=null, callback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144), errback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144)))
14:24:05.409 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.409 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.410 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.409 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [17ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [18ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [45ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [49ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [83ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [103ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [203ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [203ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [422ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [822ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1563ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3461ms] too many traces: truncated at 100 traces, deferred=Deferred@85329645(state=PENDING, result=null, callback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144), errback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [17ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [18ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [45ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [49ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [83ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [103ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [203ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [203ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [422ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [822ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1563ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3461ms] too many traces: truncated at 100 traces, deferred=Deferred@85329645(state=PENDING, result=null, callback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144), errback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:05.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.410 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.410 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.411 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.411 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.414 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [17ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [18ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [45ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [49ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [83ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [103ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [203ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [203ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [422ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [822ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1563ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3461ms] too many traces: truncated at 100 traces, deferred=Deferred@85329645(state=PENDING, result=null, callback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144), errback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [17ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [18ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [45ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [49ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [83ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [103ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [184ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [203ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [203ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [422ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [822ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [822ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1563ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3461ms] too many traces: truncated at 100 traces, deferred=Deferred@85329645(state=PENDING, result=null, callback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144), errback=(continuation of Deferred@174560204 after retry RPC after error@2005604607) -> (continuation of Deferred@843852745 after retry RPC after error@123236867) -> (continuation of Deferred@832006359 after retry RPC after error@519361274) -> (continuation of Deferred@1295364238 after retry RPC after error@163126081) -> (continuation of Deferred@56761201 after retry RPC after error@993622757) -> (continuation of Deferred@1533545676 after retry RPC after error@449472499) -> (continuation of Deferred@157306440 after retry RPC after error@2038363091) -> (continuation of Deferred@1659604572 after retry RPC after error@727156749) -> (continuation of Deferred@542019873 after retry RPC after error@782245520) -> (continuation of Deferred@268954742 after retry RPC after error@126294427) -> (continuation of Deferred@1393842131 after retry RPC after error@2104395711) -> (continuation of Deferred@1378197560 after retry RPC after error@1842425894) -> (continuation of Deferred@470440064 after retry RPC after error@365983681) -> (continuation of Deferred@1779114275 after retry RPC after error@247430212) -> (continuation of Deferred@1077934923 after retry RPC after error@1447555826) -> (continuation of Deferred@1702286112 after retry RPC after error@274648726) -> (continuation of Deferred@797219445 after retry RPC after error@1186807061) -> (continuation of Deferred@352389425 after retry RPC after error@1934450553) -> (continuation of Deferred@2022782039 after retry RPC after error@1466690501) -> (continuation of Deferred@1245587608 after retry RPC after error@1402011697) -> (continuation of Deferred@584299928 after retry RPC after error@720259012) -> (continuation of Deferred@288346345 after retry RPC after error@1248123509) -> (continuation of Deferred@1973737940 after retry RPC after error@757887171) -> (continuation of Deferred@1114330391 after retry RPC after error@783325277) -> (continuation of Deferred@2097778214 after retry RPC after error@862802732) -> (continuation of Deferred@733379515 after retry RPC after error@24018144)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:05.415 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:24:05.415 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:24:05.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
14:24:05.415 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
14:24:05.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
14:24:05.415 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
14:24:05.416 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
14:24:05.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
14:24:05.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:24:05.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
14:24:05.416 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
14:24:05.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:24:05.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
14:24:05.417 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:24:05.417 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
14:24:05.417 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
14:24:05.418 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:24:05.420 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:24:05.420 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
14:24:05.420 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:24:05.422 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:05.422 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
14:24:05.422 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:24:05.422 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:24:05.422 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
14:24:05.422 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:24:05.423 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:05.424 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
14:24:05.424 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:24:05.424 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:24:05.425 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:24:05.425 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:24:05.425 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:24:05.425 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
14:24:05.426 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
14:24:05.426 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
14:24:05.427 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.427 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
14:24:05.427 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.427 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.427 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:05.427 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.427 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.427 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.427 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.427 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.427 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.427 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:05.428 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:05.428 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:24:05.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.428 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.428 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.428 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.446 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.447 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.447 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.447 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.447 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.447 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.447 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.447 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.447 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.447 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.466 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.466 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.466 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.467 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.467 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.467 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.467 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.486 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.486 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.486 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.486 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.486 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.486 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.486 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.486 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.486 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.487 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.487 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.487 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.527 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.527 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.527 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.527 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.527 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.527 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.528 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:05.546 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:05.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:05.547 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:05.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.547 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.547 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.547 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:05.586 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:05.586 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:05.586 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:05.586 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.586 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.586 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.586 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.586 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.586 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:05.606 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.607 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.607 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.647 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.647 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.647 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.647 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.647 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.647 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.647 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.647 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.747 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:05.747 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:05.747 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:05.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.748 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.748 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:05.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:05.748 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:05.748 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:05.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114245806 for job 77d052e6e51b5ae35525074f80512696.
14:24:05.811 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:05.811 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:05.811 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:05.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.811 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:05.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.811 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.811 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.812 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:05.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:05.812 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:05.814 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:05.814 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:24:05.907 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:05.907 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:05.907 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:05.908 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.908 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.908 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.908 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.908 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.908 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.908 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.908 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.908 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.908 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:05.908 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:05.908 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27522), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [8ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [13ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [25ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [41ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [65ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [84ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [104ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [105ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [144ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [185ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [342ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [683ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [683ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [684ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2881ms] too many traces: truncated at 100 traces, deferred=Deferred@1347955136(state=PENDING, result=null, callback=(continuation of Deferred@1221349554 after retry RPC after error@1751407115) -> (continuation of Deferred@1297559760 after retry RPC after error@1557141139) -> (continuation of Deferred@1983091835 after retry RPC after error@1020083380) -> (continuation of Deferred@1214794317 after retry RPC after error@349223261) -> (continuation of Deferred@2116708336 after retry RPC after error@735566877) -> (continuation of Deferred@560451848 after retry RPC after error@820813352) -> (continuation of Deferred@500464162 after retry RPC after error@150366897) -> (continuation of Deferred@386270518 after retry RPC after error@1137693728) -> (continuation of Deferred@2113188625 after retry RPC after error@1181548028) -> (continuation of Deferred@1642360754 after retry RPC after error@1555548538) -> (continuation of Deferred@67339718 after retry RPC after error@631315367) -> (continuation of Deferred@1744468318 after retry RPC after error@90472642) -> (continuation of Deferred@491849757 after retry RPC after error@805323827) -> (continuation of Deferred@67431396 after retry RPC after error@633801014) -> (continuation of Deferred@818150515 after retry RPC after error@38799236) -> (continuation of Deferred@564692961 after retry RPC after error@1010545755) -> (continuation of Deferred@322238411 after retry RPC after error@291159566) -> (continuation of Deferred@1957209163 after retry RPC after error@365977577) -> (continuation of Deferred@569272375 after retry RPC after error@1702889674) -> (continuation of Deferred@1413178061 after retry RPC after error@1124286644) -> (continuation of Deferred@301868851 after retry RPC after error@1960684446) -> (continuation of Deferred@2080342722 after retry RPC after error@572550121) -> (continuation of Deferred@1116145441 after retry RPC after error@1537197492) -> (continuation of Deferred@1559344535 after retry RPC after error@2100294339) -> (continuation of Deferred@124472392 after retry RPC after error@578587508) -> (continuation of Deferred@1936777121 after retry RPC after error@1909162726) -> (continuation of Deferred@740264347 after retry RPC after error@1795067975), errback=(continuation of Deferred@1221349554 after retry RPC after error@1751407115) -> (continuation of Deferred@1297559760 after retry RPC after error@1557141139) -> (continuation of Deferred@1983091835 after retry RPC after error@1020083380) -> (continuation of Deferred@1214794317 after retry RPC after error@349223261) -> (continuation of Deferred@2116708336 after retry RPC after error@735566877) -> (continuation of Deferred@560451848 after retry RPC after error@820813352) -> (continuation of Deferred@500464162 after retry RPC after error@150366897) -> (continuation of Deferred@386270518 after retry RPC after error@1137693728) -> (continuation of Deferred@2113188625 after retry RPC after error@1181548028) -> (continuation of Deferred@1642360754 after retry RPC after error@1555548538) -> (continuation of Deferred@67339718 after retry RPC after error@631315367) -> (continuation of Deferred@1744468318 after retry RPC after error@90472642) -> (continuation of Deferred@491849757 after retry RPC after error@805323827) -> (continuation of Deferred@67431396 after retry RPC after error@633801014) -> (continuation of Deferred@818150515 after retry RPC after error@38799236) -> (continuation of Deferred@564692961 after retry RPC after error@1010545755) -> (continuation of Deferred@322238411 after retry RPC after error@291159566) -> (continuation of Deferred@1957209163 after retry RPC after error@365977577) -> (continuation of Deferred@569272375 after retry RPC after error@1702889674) -> (continuation of Deferred@1413178061 after retry RPC after error@1124286644) -> (continuation of Deferred@301868851 after retry RPC after error@1960684446) -> (continuation of Deferred@2080342722 after retry RPC after error@572550121) -> (continuation of Deferred@1116145441 after retry RPC after error@1537197492) -> (continuation of Deferred@1559344535 after retry RPC after error@2100294339) -> (continuation of Deferred@124472392 after retry RPC after error@578587508) -> (continuation of Deferred@1936777121 after retry RPC after error@1909162726) -> (continuation of Deferred@740264347 after retry RPC after error@1795067975)))
14:24:05.908 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:05.909 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.909 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.909 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:05.909 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:05.909 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.909 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.909 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:05.909 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.909 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:05.909 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:05.912 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:05.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.913 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.13.91.124:35565(127.13.91.124:35565) for tablet Kudu Master: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.915 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:05.915 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:05.916 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:05.916 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.916 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.916 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.916 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.916 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.916 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.916 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:05.934 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:05.934 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:05.935 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:05.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.936 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:05.954 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:05.954 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:05.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.954 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:05.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:05.975 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:05.975 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:05.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.975 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:05.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:05.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:05.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:05.976 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.015 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.015 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.015 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.016 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:06.075 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.075 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.075 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.075 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.094 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.094 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.095 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.095 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.126 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:06.126 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:06.127 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:06.127 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.127 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.127 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.127 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.127 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.127 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.127 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:06.154 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.155 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.155 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.155 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.214 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.215 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.215 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.215 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.215 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.216 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114246306 for job 77d052e6e51b5ae35525074f80512696.
14:24:06.314 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:06.315 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:24:06.410 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:06.410 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:06.410 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:06.411 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:06.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:06.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:06.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:06.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:06.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:06.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:06.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:06.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:06.411 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
.14:24:06.431 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114246431
14:24:06.432 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114246432
14:24:06.435 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:24:06.438 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:24:06.438 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:24:06.438 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:24:06.439 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:24:06.439 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:24:06.441 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:24:06.490 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:06.490 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:06.491 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:06.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:06.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:06.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:06.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:06.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:06.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:06.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:06.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:06.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:06.491 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:06.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:06.635 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:06.635 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:06.635 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:06.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.635 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.635 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:06.636 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:06.636 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:06.636 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:06.767 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:24:06.767 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:24:06.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:06.770797 15568 mini_oidc.cc:150] Starting JWKS server
14:24:06.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:06.773816 15568 webserver.cc:533] Webserver started at http://127.0.0.1:33933/ using document root <none> and password file <none>
14:24:06.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:06.774281 15568 mini_oidc.cc:186] Starting OIDC Discovery server
14:24:06.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:06.776032 15568 webserver.cc:533] Webserver started at http://127.0.0.1:37483/ using document root <none> and password file <none>
14:24:06.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114246806 for job 77d052e6e51b5ae35525074f80512696.
14:24:06.815 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:06.816 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:24:06.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:24:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:06Z Disabled control of system clock
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:06.837078 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/logs
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data/info.pb
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.62:42455
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.62
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json with env {}
14:24:06.909 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:06.909 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:06.909 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:06.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:06.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:06.909 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:06.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:06.909 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:06.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:06.910 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:06.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:06.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:06.910 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:06.910 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=32, TimeoutTracker(timeout=30000, elapsed=28524), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [16ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [17ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [18ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [31ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [39ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [42ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [65ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [65ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [66ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [66ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [84ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [103ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [144ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [167ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [168ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [302ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [801ms] refreshing cache from master, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [803ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [804ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [806ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [806ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1264ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2704ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2704ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1979124427(state=PENDING, result=null, callback=(continuation of Deferred@1123195291 after retry RPC after error@1171741406) -> (continuation of Deferred@1774386089 after retry RPC after error@606995720) -> (continuation of Deferred@1925611095 after retry RPC after error@221825915) -> (continuation of Deferred@1935238854 after retry RPC after error@655043552) -> (continuation of Deferred@1727978896 after retry RPC after error@760656167) -> (continuation of Deferred@360811805 after retry RPC after error@1806426214) -> (continuation of Deferred@2074718942 after retry RPC after error@1676606213) -> (continuation of Deferred@2057206528 after retry RPC after error@1317149925) -> (continuation of Deferred@2014013609 after retry RPC after error@1814663806) -> (continuation of Deferred@1701229184 after retry RPC after error@996016125) -> (continuation of Deferred@414221855 after retry RPC after error@950689045) -> (continuation of Deferred@1753745970 after retry RPC after error@1014936265) -> (continuation of Deferred@543312679 after retry RPC after error@1254811851) -> (continuation of Deferred@1648075322 after retry RPC after error@723172430) -> (continuation of Deferred@429121913 after retry RPC after error@67296816) -> (continuation of Deferred@999786232 after retry RPC after error@1158784264) -> (continuation of Deferred@1125059834 after retry RPC after error@1374595573) -> (continuation of Deferred@1447642486 after retry RPC after error@507024210) -> (continuation of Deferred@627778739 after retry RPC after error@32407786) -> (continuation of Deferred@495982420 after retry RPC after error@1206433207) -> (continuation of Deferred@1004166981 after retry RPC after error@1313239300) -> (continuation of Deferred@1408365871 after retry RPC after error@1362540523) -> (continuation of Deferred@947911423 after retry RPC after error@1162637989) -> (continuation of Deferred@432582574 after retry RPC after error@2099632787) -> (continuation of Deferred@986345418 after retry RPC after error@473299820) -> (continuation of Deferred@1079804571 after retry RPC after error@327039297) -> (continuation of Deferred@2049155291 after retry RPC after error@1241438824) -> (continuation of Deferred@1829945750 after retry RPC after error@264526148) -> (continuation of Deferred@1753617695 after retry RPC after error@1460977661) -> (continuation of Deferred@745659128 after retry RPC after error@30582859) -> (continuation of Deferred@1495563139 after retry RPC after error@725470221), errback=(continuation of Deferred@1123195291 after retry RPC after error@1171741406) -> (continuation of Deferred@1774386089 after retry RPC after error@606995720) -> (continuation of Deferred@1925611095 after retry RPC after error@221825915) -> (continuation of Deferred@1935238854 after retry RPC after error@655043552) -> (continuation of Deferred@1727978896 after retry RPC after error@760656167) -> (continuation of Deferred@360811805 after retry RPC after error@1806426214) -> (continuation of Deferred@2074718942 after retry RPC after error@1676606213) -> (continuation of Deferred@2057206528 after retry RPC after error@1317149925) -> (continuation of Deferred@2014013609 after retry RPC after error@1814663806) -> (continuation of Deferred@1701229184 after retry RPC after error@996016125) -> (continuation of Deferred@414221855 after retry RPC after error@950689045) -> (continuation of Deferred@1753745970 after retry RPC after error@1014936265) -> (continuation of Deferred@543312679 after retry RPC after error@1254811851) -> (continuation of Deferred@1648075322 after retry RPC after error@723172430) -> (continuation of Deferred@429121913 after retry RPC after error@67296816) -> (continuation of Deferred@999786232 after retry RPC after error@1158784264) -> (continuation of Deferred@1125059834 after retry RPC after error@1374595573) -> (continuation of Deferred@1447642486 after retry RPC after error@507024210) -> (continuation of Deferred@627778739 after retry RPC after error@32407786) -> (continuation of Deferred@495982420 after retry RPC after error@1206433207) -> (continuation of Deferred@1004166981 after retry RPC after error@1313239300) -> (continuation of Deferred@1408365871 after retry RPC after error@1362540523) -> (continuation of Deferred@947911423 after retry RPC after error@1162637989) -> (continuation of Deferred@432582574 after retry RPC after error@2099632787) -> (continuation of Deferred@986345418 after retry RPC after error@473299820) -> (continuation of Deferred@1079804571 after retry RPC after error@327039297) -> (continuation of Deferred@2049155291 after retry RPC after error@1241438824) -> (continuation of Deferred@1829945750 after retry RPC after error@264526148) -> (continuation of Deferred@1753617695 after retry RPC after error@1460977661) -> (continuation of Deferred@745659128 after retry RPC after error@30582859) -> (continuation of Deferred@1495563139 after retry RPC after error@725470221)))
14:24:06.946 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:06.946 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:06.947 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:06.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:06.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:06.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:06.947 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:07.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.120206 15580 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:07.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.120719 15580 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:07.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.121204 15580 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.150319 15580 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.150560 15580 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.150772 15580 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.150985 15580 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.151176 15580 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.151448 15580 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33933/jwks.json
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:07.184425 15580 master_runner.cc:387] Master server non-default flags:
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.62:42455
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data/info.pb
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.62
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/logs
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:07.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:07.185635 15580 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:07.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:07.187145 15580 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:07.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.197219 15586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:07.302 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:07.302 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:07.302 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:07.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.303 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.303 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.303 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.303 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:07.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114247307 for job 77d052e6e51b5ae35525074f80512696.
14:24:07.320 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:24:07.322 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:24:07.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:07.675 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:07.675 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:07.676 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:07.676 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:07.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:07.676 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:07.676 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:07.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:07.677 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:07.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:07.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:07.677 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:07.677 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:07.687 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:24:07.688 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:24:07.689 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:24:07.689 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:24:07.690 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
14:24:07.691 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:07.691 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
14:24:07.691 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:24:07.691 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
14:24:07.692 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:24:07.692 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
14:24:07.692 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:24:07.693 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
14:24:07.693 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
14:24:07.693 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:24:07.693 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
14:24:07.694 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:07.694 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:07.694 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
14:24:07.694 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:07.694 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:24:07.693 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:24:07.695 [INFO - Thread-28] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:24:07.695 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:24:07.695 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:24:07.696 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:24:07.696 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:24:07.696 [DEBUG - Thread-28] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:07.698 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:24:07.697 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
14:24:07.698 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
14:24:07.699 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:24:07.699 [INFO - Thread-28] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:24:07.700 [INFO - Thread-28] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:24:07.700 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:24:07.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
14:24:07.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
14:24:07.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60d3aa09
14:24:07.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:07.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:07.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:24:07.703 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:24:07.704 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:24:07.705 [DEBUG - Thread-28] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:07.705 [INFO - Thread-28] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:07.705 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:24:07.705 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@755e001f
14:24:07.705 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:07.705 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:07.706 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:24:07.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
14:24:07.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
14:24:07.706 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:24:07.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@22eb126a
14:24:07.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:07.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:07.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:24:07.708 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:24:07.710 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:07.711 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:07.711 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:07.711 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:07.711 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@196354ac
14:24:07.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
14:24:07.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
14:24:07.713 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73f9608
14:24:07.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54235300
14:24:07.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:07.714 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:07.714 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:24:07.714 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:24:07.718 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:07.719 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:07.722 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c27ed84
14:24:07.724 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:07.725 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d817892
14:24:07.730 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:07.731 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.734 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.735 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.737 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.738 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.739 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.740 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.743 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.746 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.746 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.746 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.746 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.748 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.750 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.750 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.750 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.750 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.752 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.752 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.753 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.753 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.753 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.754 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.755 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.758 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.758 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.758 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.759 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.759 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.759 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.759 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.760 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.762 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.762 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.762 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.762 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.765 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.766 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.767 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.767 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.771 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.771 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:07.771 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:07.771 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:07.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.772 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.772 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.772 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.772 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:07.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.775 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.775 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.775 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.778 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.778 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.779 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.779 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.784 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.785 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.785 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.785 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.785 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.786 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.787 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.787 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.788 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.788 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.788 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.788 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.789 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.790 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.790 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.790 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.790 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.791 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.791 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.791 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.791 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.792 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.792 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.792 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.792 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.792 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.793 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.793 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.797 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.798 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.798 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.801 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.801 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.801 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.801 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.801 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.802 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.802 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.802 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114247806 for job 77d052e6e51b5ae35525074f80512696.
14:24:07.815 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.818 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.819 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.820 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.824 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.824 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.824 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.824 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.829 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=18 ms, finalizationTime=5 ms).
14:24:07.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:24:07.836 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:07.836 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:07.836 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:07.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.837 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:07.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:07.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:07.838 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.838 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:07.838 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.838 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.839 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.839 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.839 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.839 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.839 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.839 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.843 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.843 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.843 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.843 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.851 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.852 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.852 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.853 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.854 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.854 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.858 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.862 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.862 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.862 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.862 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.863 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.863 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.863 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.870 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.871 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.872 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.872 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.873 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.874 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.874 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.874 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.874 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.875 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.878 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.878 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.878 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.879 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.879 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.879 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.879 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.879 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.879 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.880 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.880 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.880 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.880 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.883 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.883 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.888 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.889 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.889 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.889 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.889 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.889 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.895 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.895 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.895 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.898 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.898 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.898 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.898 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.898 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.899 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.899 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.899 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.899 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.899 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.900 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.900 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.901 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.901 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.901 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.901 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.914 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.915 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.915 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.916 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.916 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.916 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.917 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.919 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.919 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.919 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.920 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.930 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.931 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.934 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.934 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.935 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.935 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.935 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.935 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.936 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.936 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.936 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.936 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.937 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.937 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.938 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.938 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.938 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.939 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.939 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.939 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.940 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.952 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.952 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.952 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.952 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.952 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.953 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.953 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.953 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.953 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.953 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.953 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.953 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.954 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.954 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.955 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.955 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.956 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.956 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.956 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.957 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.975 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.975 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.976 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.976 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.977 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.978 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:07.978 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:07.978 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:07.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.978 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.979 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:07.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:07.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:07.980 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:07.992 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.992 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.992 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.993 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.993 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.993 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.993 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.993 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.993 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.993 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.993 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.993 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.993 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.994 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.994 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.994 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.995 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.995 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:07.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.995 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:07.995 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:07.996 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:07.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:07.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:07.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:07.997 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.018 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:08.018 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:08.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.018 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:08.019 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.019 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.019 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.019 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:08.020 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.020 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.020 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.021 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.023 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:08.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:08.114 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.115 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.115 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.116 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.116 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.116 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.116 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.117 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.117 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.120 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.132 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.132 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.132 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.133 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.133 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.133 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.139 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.139 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.139 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.140 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.140 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.140 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.141 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.191 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:08.192 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:08.192 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:08.192 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.193 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.193 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.193 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.193 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.193 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.193 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.193 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.193 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:08.214 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.215 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.215 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.216 [INFO - pool-148-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.216 [WARN - pool-148-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.247 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.248 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.248 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.248 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.249 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.249 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29866), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [13ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [13ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [14ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [15ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [40ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [67ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [85ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [104ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [104ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [144ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [167ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [169ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [242ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [982ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [983ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [984ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [984ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2941ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2942ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2942ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2942ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2942ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@938467680(state=PENDING, result=null, callback=(continuation of Deferred@1663819353 after retry RPC after error@1775317829) -> (continuation of Deferred@1212731049 after retry RPC after error@6607393) -> (continuation of Deferred@1023417698 after retry RPC after error@1571510940) -> (continuation of Deferred@1394141702 after retry RPC after error@1976295326) -> (continuation of Deferred@1218258760 after retry RPC after error@1340468093) -> (continuation of Deferred@1538879581 after retry RPC after error@1881498523) -> (continuation of Deferred@1361296816 after retry RPC after error@838666986) -> (continuation of Deferred@559329040 after retry RPC after error@2058631450) -> (continuation of Deferred@909559233 after retry RPC after error@1866806199) -> (continuation of Deferred@2071932768 after retry RPC after error@551069180) -> (continuation of Deferred@541095147 after retry RPC after error@1717449695) -> (continuation of Deferred@1683493979 after retry RPC after error@21670505) -> (continuation of Deferred@571371911 after retry RPC after error@895057618) -> (continuation of Deferred@285695726 after retry RPC after error@1170908997) -> (continuation of Deferred@337212466 after retry RPC after error@1791502221) -> (continuation of Deferred@1091822612 after retry RPC after error@1366524924) -> (continuation of Deferred@244634884 after retry RPC after error@634089236) -> (continuation of Deferred@2074479869 after retry RPC after error@906435606) -> (continuation of Deferred@513004327 after retry RPC after error@1625209902) -> (continuation of Deferred@735352108 after retry RPC after error@624806892) -> (continuation of Deferred@624377479 after retry RPC after error@815651267) -> (continuation of Deferred@1072649993 after retry RPC after error@1959172531) -> (continuation of Deferred@1746490026 after retry RPC after error@915721643) -> (continuation of Deferred@1938199407 after retry RPC after error@869107629) -> (continuation of Deferred@300097404 after retry RPC after error@17461630), errback=(continuation of Deferred@1663819353 after retry RPC after error@1775317829) -> (continuation of Deferred@1212731049 after retry RPC after error@6607393) -> (continuation of Deferred@1023417698 after retry RPC after error@1571510940) -> (continuation of Deferred@1394141702 after retry RPC after error@1976295326) -> (continuation of Deferred@1218258760 after retry RPC after error@1340468093) -> (continuation of Deferred@1538879581 after retry RPC after error@1881498523) -> (continuation of Deferred@1361296816 after retry RPC after error@838666986) -> (continuation of Deferred@559329040 after retry RPC after error@2058631450) -> (continuation of Deferred@909559233 after retry RPC after error@1866806199) -> (continuation of Deferred@2071932768 after retry RPC after error@551069180) -> (continuation of Deferred@541095147 after retry RPC after error@1717449695) -> (continuation of Deferred@1683493979 after retry RPC after error@21670505) -> (continuation of Deferred@571371911 after retry RPC after error@895057618) -> (continuation of Deferred@285695726 after retry RPC after error@1170908997) -> (continuation of Deferred@337212466 after retry RPC after error@1791502221) -> (continuation of Deferred@1091822612 after retry RPC after error@1366524924) -> (continuation of Deferred@244634884 after retry RPC after error@634089236) -> (continuation of Deferred@2074479869 after retry RPC after error@906435606) -> (continuation of Deferred@513004327 after retry RPC after error@1625209902) -> (continuation of Deferred@735352108 after retry RPC after error@624806892) -> (continuation of Deferred@624377479 after retry RPC after error@815651267) -> (continuation of Deferred@1072649993 after retry RPC after error@1959172531) -> (continuation of Deferred@1746490026 after retry RPC after error@915721643) -> (continuation of Deferred@1938199407 after retry RPC after error@869107629) -> (continuation of Deferred@300097404 after retry RPC after error@17461630)))
14:24:08.277 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:08.277 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:08.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:08.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.278 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.278 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.278 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.279 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:08.282 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:08.282 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:08.282 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.282 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:08.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.283 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.283 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.283 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.283 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.283 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.283 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:08.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114248306 for job 77d052e6e51b5ae35525074f80512696.
14:24:08.321 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:24:08.322 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:24:08.346 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.346 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.346 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.347 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.347 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.347 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.347 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.348 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29943), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [3ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [7ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [7ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [30ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [32ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [32ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [49ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [49ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [50ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [83ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [103ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [164ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [166ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [221ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [263ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [343ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [343ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [343ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1101ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1104ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1982ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@1312606229(state=PENDING, result=null, callback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942) -> (continuation of Deferred@1997095098 after retry RPC after error@1360082613), errback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942) -> (continuation of Deferred@1997095098 after retry RPC after error@1360082613)))
14:24:08.356 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.356 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.356 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.356 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.356 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.356 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.357 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.357 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.357 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.357 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.357 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.357 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.357 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.399 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.399 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.399 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.399 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.400 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.400 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.400 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.400 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.400 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:07.198482 15587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.441902 15589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.444171 15588 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1241 milliseconds
14:24:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.444269 15580 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.445458 15580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:08.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.448256 15580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:08.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.449579 15580 hybrid_clock.cc:648] HybridClock initialized: now 1779114248449536 us; error 36 us; skew 500 ppm
14:24:08.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.450395 15580 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:08.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.456182 15580 webserver.cc:533] Webserver started at http://127.15.52.62:38451/ using document root <none> and password file <none>
14:24:08.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.457010 15580 fs_manager.cc:362] Metadata directory not provided
14:24:08.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.457206 15580 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:08.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.457577 15580 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:08.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.461474 15580 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data/instance:
14:24:08.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a62f7d8cfb6c4d42996063d78ff7d179"
14:24:08.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:08 on dist-test-slave-1n46"
14:24:08.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.462621 15580 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal/instance:
14:24:08.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a62f7d8cfb6c4d42996063d78ff7d179"
14:24:08.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:08 on dist-test-slave-1n46"
14:24:08.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.469024 15580 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
14:24:08.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.474330 15650 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:08.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.475297 15580 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
14:24:08.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.475553 15580 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal
14:24:08.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a62f7d8cfb6c4d42996063d78ff7d179"
14:24:08.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:08 on dist-test-slave-1n46"
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.475870 15580 fs_report.cc:389] FS layout report
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data/data
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:08.491 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:08.491 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:08.491 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:08.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.492 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.492 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:08.492 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.492 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.492 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.492 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.492 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.492 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.497 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:08.497 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:08.497 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:08.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.498 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.498 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:08.498 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.498 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:08.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.498 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:08.498 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:08.511 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.512 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.512 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.512 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.512 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.512 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:08.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.562997 15580 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:08.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.564252 15580 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:08.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.564678 15580 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:08.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.636446 15580 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.62:42455
14:24:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.636529 15701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.62:42455 every 8 connection(s)
14:24:08.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.638980 15580 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/data/info.pb
14:24:08.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.644732 15702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.647763 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 15580
14:24:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.648183 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-0/wal/instance
14:24:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.651527 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal
14:24:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/logs
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data/info.pb
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.61:40475
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.61
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json with env {}
14:24:08.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.655499 15702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } has no permanent_uuid. Determining permanent_uuid...
14:24:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.682687 15702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
14:24:08.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.685359 15652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:08.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.689611 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:08.695 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.695 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.695 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.739133 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 1
14:24:08.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.743232 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:08.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:08.783 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:08.783 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:08.783 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.783 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.783 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:08.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:08.784 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.784 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:08.784 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:08.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114248806 for job 77d052e6e51b5ae35525074f80512696.
14:24:08.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.811707 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 2
14:24:08.816 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.816 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.816 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.816392 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:08.817 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.817 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.817 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.816 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:24:08.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.818 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.818 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:24:08.899 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:08.899 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:08.900 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:08.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:08.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.900 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:08.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.900 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.900 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:08.900 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:08.907871 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 3
14:24:08.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.912923 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.965728 15704 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.966445 15704 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.967075 15704 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:08.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.999074 15704 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:08.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.999447 15704 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:08.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:08.999752 15704 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:09.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.000061 15704 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:09.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.000351 15704 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:09.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.000610 15704 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33933/jwks.json
14:24:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.034548 15704 master_runner.cc:387] Master server non-default flags:
14:24:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.61:40475
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data/info.pb
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.61
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/logs
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:09.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.036036 15704 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:09.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.037582 15704 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:09.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:09.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.048098 15713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:09.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.056396 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 4
14:24:09.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.062196 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:09.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:09.239 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:09.239 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:09.239 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:09.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.242 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.242 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:09.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114249306 for job 77d052e6e51b5ae35525074f80512696.
14:24:09.323 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:09.323 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:09.323 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:09.324 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.324 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.324 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.325 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.325 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:09.329 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
14:24:09.330 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:09.330 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:09.331 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:09.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:09.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:09.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:09.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:09.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:09.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:09.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:09.331 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:09.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:09.331 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:09.332 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:24:09.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.361642 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 5
14:24:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.370088 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:09.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:09.556 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:09.556 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:09.557 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:09.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.558 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.558 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.558 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.559 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.559 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.559 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:09.574 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:09.574 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:09.575 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:09.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.575 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.577 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.577 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.577 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:09.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:09.652 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:09.652 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:09.652 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:09.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.653 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.653 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:09.678 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:09.678 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:09.679 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:09.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:09.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:09.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:09.679 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:09.679 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:09.679 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:09.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:09.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:09.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:09.679 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:09.690 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:09.690 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:09.690 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:09.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.691 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.691 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.691 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.691 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.691 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.691 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.691 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:09.772 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:09.772 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:09.772 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:09.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.773 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.773 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:09.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:09.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:09.773 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:09.808 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114249807 for job 77d052e6e51b5ae35525074f80512696.
14:24:09.825 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:24:09.826 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:24:09.852 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:09.852 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:09.852 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:09.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:09.853 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.853 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:09.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:09.854 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:09.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:09.917732 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 6
14:24:09.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.928361 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.61:40475: Network error: Client connection negotiation failed: client connection to 127.15.52.61:40475: connect: Connection refused (error 111)
14:24:10.031 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:10.031 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:10.032 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:10.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:10.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:10.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:10.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:10.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:10.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:10.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:10.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:10.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:10.034 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:10.036 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:10.037 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:10.037 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:10.039 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.039 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.040 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.040 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.040 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.040 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.041 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.041 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:10.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:10.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:10.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114250307 for job 77d052e6e51b5ae35525074f80512696.
14:24:10.323 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
14:24:10.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:24:10.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:09.048559 15714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:10.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.389308 15704 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.341s	user 0.398s	sys 0.869s
14:24:10.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.389693 15704 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.341s	user 0.398s	sys 0.869s
14:24:10.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.391098 15716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:10.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.391338 15715 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1340 milliseconds
14:24:10.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.391331 15704 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:10.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.392733 15704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:10.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.395172 15704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:10.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.396538 15704 hybrid_clock.cc:648] HybridClock initialized: now 1779114250396487 us; error 49 us; skew 500 ppm
14:24:10.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.397387 15704 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:10.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.405054 15704 webserver.cc:533] Webserver started at http://127.15.52.61:41623/ using document root <none> and password file <none>
14:24:10.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.405884 15704 fs_manager.cc:362] Metadata directory not provided
14:24:10.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.406194 15704 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:10.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.406702 15704 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:10.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.411409 15704 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data/instance:
14:24:10.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "310a4cf2ebb146eabc9fc7966b4be743"
14:24:10.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:10 on dist-test-slave-1n46"
14:24:10.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.412497 15704 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal/instance:
14:24:10.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "310a4cf2ebb146eabc9fc7966b4be743"
14:24:10.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:10 on dist-test-slave-1n46"
14:24:10.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.420380 15704 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.005s
14:24:10.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.426636 15725 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:10.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.427968 15704 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
14:24:10.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.428328 15704 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal
14:24:10.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "310a4cf2ebb146eabc9fc7966b4be743"
14:24:10.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:10 on dist-test-slave-1n46"
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.428828 15704 fs_report.cc:389] FS layout report
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data/data
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:10.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.506728 15704 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:10.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.508052 15704 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:10.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.508594 15704 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:10.511 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:10.511 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:10.511 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:10.512 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:10.512 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:10.512 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:10.512 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:10.512 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:10.512 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:10.513 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:10.513 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:10.513 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:10.513 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:10.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:10.559 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:10.559 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:10.559 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:10.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.559 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.559 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.560 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.560 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.560 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.560 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.560 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:10.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.582271 15704 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.61:40475
14:24:10.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.582319 15776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.61:40475 every 8 connection(s)
14:24:10.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.584995 15704 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/data/info.pb
14:24:10.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.591187 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:10.595 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:10.595 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:10.595 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:10.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.595306 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 15704
14:24:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.595708 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-1/wal/instance
14:24:10.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.596 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.596 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.596 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.597868 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/logs
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data/info.pb
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.60:41453
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.60
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json with env {}
14:24:10.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.602140 15777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } has no permanent_uuid. Determining permanent_uuid...
14:24:10.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:10.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.621948 15777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
14:24:10.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.635097 15777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } has no permanent_uuid. Determining permanent_uuid...
14:24:10.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.637841 15728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:10.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.648882 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:10.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.698313 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 1
14:24:10.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.702783 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:10.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.771157 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 2
14:24:10.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.775238 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:10.806 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114250806 for job 77d052e6e51b5ae35525074f80512696.
14:24:10.818 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:24:10.819 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:24:10.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.866578 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 3
14:24:10.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.870486 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:10.891 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:10.892 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:10.892 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:10.892 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:10.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:10.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:10.892 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.914880 15779 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.915527 15779 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:10.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.916169 15779 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.947412 15779 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.947762 15779 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.948062 15779 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.948349 15779 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.948642 15779 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.948909 15779 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33933/jwks.json
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.983264 15779 master_runner.cc:387] Master server non-default flags:
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.60:41453
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33933/jwks.json
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data/info.pb
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.60
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/logs
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.984707 15779 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:10.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.986316 15779 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:10.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:10.988914 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } attempt: 7
14:24:11.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.999805 15790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:11.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.004052 15702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } has no permanent_uuid. Determining permanent_uuid...
14:24:11.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.013837 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 4
14:24:11.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.020437 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.024655 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.038 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:11.038 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:11.039 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:11.039 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:11.039 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:11.039 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:11.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:11.040 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:11.040 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:11.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:11.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:11.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:11.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:11.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:11.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.043 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:11.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:11.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:11.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:11.055 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:11.055 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:11.055 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:11.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.057 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:11.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.083154 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 1
14:24:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.090662 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.102 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:11.103 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:11.103 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:11.103 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.103 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.104 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.104 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.104 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.105 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:11.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:11.155 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:11.155 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:11.155 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:11.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.157 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:11.158 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:11.158 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:11.158 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:11.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:11.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:11.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:11.159 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.172237 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 2
14:24:11.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.179639 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.265166 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 3
14:24:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.273623 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114251306 for job 77d052e6e51b5ae35525074f80512696.
14:24:11.316 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:11.316 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:11.316 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:11.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:11.318 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.318 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.318 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:11.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.319 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:11.319 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:11.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.319895 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 5
14:24:11.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.324915 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.327 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
14:24:11.329 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:24:11.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.414140 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 4
14:24:11.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.422444 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:11.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:11.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.706063 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 5
14:24:11.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.715415 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:11.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114251806 for job 77d052e6e51b5ae35525074f80512696.
14:24:11.832 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=26 ms, finalizationTime=0 ms).
14:24:11.834 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:24:11.852 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:11.853 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:11.853 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:11.853 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.853 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.853 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:11.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:11.853 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.854 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.854 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:11.854 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:11.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:11.872320 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 6
14:24:11.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:11.892608 15777 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:12.047 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:12.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.267939 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 6
14:24:12.290 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:12.291 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:12.291 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:12.291 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.292 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.292 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.293 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:12.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.297076 15702 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.52.60:41453: Network error: Client connection negotiation failed: client connection to 127.15.52.60:41453: connect: Connection refused (error 111)
14:24:12.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114252306 for job 77d052e6e51b5ae35525074f80512696.
14:24:12.329 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
14:24:12.331 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:24:12.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:10.999845 15791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:12.392 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:12.392 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:12.392 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:12.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.393 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:12.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:12.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:12.393 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.398363 15792 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1396 milliseconds
14:24:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.399153 15793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.400490 15779 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.401s	user 0.462s	sys 0.920s
14:24:12.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.400847 15779 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.402s	user 0.462s	sys 0.920s
14:24:12.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.401150 15779 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:12.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.402657 15779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:12.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.405544 15779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:12.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.407087 15779 hybrid_clock.cc:648] HybridClock initialized: now 1779114252407043 us; error 28 us; skew 500 ppm
14:24:12.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.408241 15779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:12.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.416713 15779 webserver.cc:533] Webserver started at http://127.15.52.60:43199/ using document root <none> and password file <none>
14:24:12.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.418109 15779 fs_manager.cc:362] Metadata directory not provided
14:24:12.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.418412 15779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:12.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.419050 15779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.426008 15779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data/instance:
14:24:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdfd7eced1c04c908db986bed9eaac3d"
14:24:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:12 on dist-test-slave-1n46"
14:24:12.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.427111 15779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal/instance:
14:24:12.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdfd7eced1c04c908db986bed9eaac3d"
14:24:12.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:12 on dist-test-slave-1n46"
14:24:12.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.434403 15779 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
14:24:12.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.440584 15806 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:12.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.441852 15779 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
14:24:12.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.442260 15779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal
14:24:12.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdfd7eced1c04c908db986bed9eaac3d"
14:24:12.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:12 on dist-test-slave-1n46"
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.442806 15779 fs_report.cc:389] FS layout report
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data/data
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:12.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:12.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:12.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:12.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.496 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.496 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:12.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.532630 15779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.533947 15779 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.534387 15779 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:12.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:12.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:12.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:12.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:12.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:12.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:12.577 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.577 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:12.577 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:12.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:12.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.622506 15779 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.60:41453
14:24:12.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.622589 15857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.60:41453 every 8 connection(s)
14:24:12.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.625154 15779 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/data/info.pb
14:24:12.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.625821 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 15779
14:24:12.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.626304 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/master-2/wal/instance
14:24:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.632448 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:12.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.647426 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } has no permanent_uuid. Determining permanent_uuid...
14:24:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.688788 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
14:24:12.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.699199 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } has no permanent_uuid. Determining permanent_uuid...
14:24:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.714031 15858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: Bootstrap starting.
14:24:12.714 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:12.715 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:12.715 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:12.715 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:12.715 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:12.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:12.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:12.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:12.715 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:12.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:12.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:12.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:12.716 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:12.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.720388 15858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: Neither blocks nor log segments found. Creating new log.
14:24:12.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.722307 15858 log.cc:826] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: Log is configured to *not* fsync() on all Append() calls
14:24:12.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.726181 15858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: No bootstrap required, opened a new log
14:24:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.744835 15858 raft_consensus.cc:359] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.745407 15858 raft_consensus.cc:385] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.745581 15858 raft_consensus.cc:740] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfd7eced1c04c908db986bed9eaac3d, State: Initialized, Role: FOLLOWER
14:24:12.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.746209 15858 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:12.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.749159 15867 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:12.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.749919 15867 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: This master's current role is: FOLLOWER
14:24:12.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.750769 15858 sys_catalog.cc:565] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: configured and running, proceeding with master startup.
14:24:12.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.774148 15878 catalog_manager.cc:1594] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:24:12.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.774407 15878 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:24:12.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:12.789665 15812 tablet.cc:2404] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:12.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.769428 15779 master_runner.cc:187] Error getting master registration for 127.15.52.62:42455: OK, instance_id { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" instance_seqno: 1779114248616485 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:24:12.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.791219 15779 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:24:12.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114252806 for job 77d052e6e51b5ae35525074f80512696.
14:24:12.815 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:12.815 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:24:12.851 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:12.851 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:12.851 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:12.852 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:12.852 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:12.852 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:12.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:12.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:12.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:12.852 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:12.852 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:12.852 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:12.853 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:12.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.953101 15777 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 7
14:24:12.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.973724 15777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: Bootstrap starting.
14:24:12.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.979636 15777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: Neither blocks nor log segments found. Creating new log.
14:24:12.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.981335 15777 log.cc:826] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: Log is configured to *not* fsync() on all Append() calls
14:24:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:12.985246 15777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: No bootstrap required, opened a new log
14:24:13.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.004613 15777 raft_consensus.cc:359] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.005137 15777 raft_consensus.cc:385] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:13.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.005412 15777 raft_consensus.cc:740] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 310a4cf2ebb146eabc9fc7966b4be743, State: Initialized, Role: FOLLOWER
14:24:13.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.006173 15777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.008720 15882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.009477 15882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.010388 15777 sys_catalog.cc:565] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: configured and running, proceeding with master startup.
14:24:13.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.017688 15731 tablet.cc:2404] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:13.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.039310 15893 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:24:13.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.039619 15893 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:24:13.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:13.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.047369 15867 raft_consensus.cc:493] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:13.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.047912 15867 raft_consensus.cc:515] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.052310 15752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd7eced1c04c908db986bed9eaac3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "310a4cf2ebb146eabc9fc7966b4be743" is_pre_election: true
14:24:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.053064 15752 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfd7eced1c04c908db986bed9eaac3d in term 0.
14:24:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.056383 15867 leader_election.cc:290] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62f7d8cfb6c4d42996063d78ff7d179 (127.15.52.62:42455), 310a4cf2ebb146eabc9fc7966b4be743 (127.15.52.61:40475)
14:24:13.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.057673 15808 leader_election.cc:304] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 310a4cf2ebb146eabc9fc7966b4be743, bdfd7eced1c04c908db986bed9eaac3d; no voters: 
14:24:13.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.058496 15867 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.058780 15867 raft_consensus.cc:493] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.059183 15867 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 0 FOLLOWER]: Advancing to term 1
14:24:13.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.065809 15867 raft_consensus.cc:515] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.068732 15752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd7eced1c04c908db986bed9eaac3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "310a4cf2ebb146eabc9fc7966b4be743"
14:24:13.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.069257 15752 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 0 FOLLOWER]: Advancing to term 1
14:24:13.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.075809 15752 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdfd7eced1c04c908db986bed9eaac3d in term 1.
14:24:13.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.076807 15808 leader_election.cc:304] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 310a4cf2ebb146eabc9fc7966b4be743, bdfd7eced1c04c908db986bed9eaac3d; no voters: 
14:24:13.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.082533 15867 leader_election.cc:290] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [CANDIDATE]: Term 1 election: Requested vote from peers a62f7d8cfb6c4d42996063d78ff7d179 (127.15.52.62:42455), 310a4cf2ebb146eabc9fc7966b4be743 (127.15.52.61:40475)
14:24:13.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.083542 15867 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 1 FOLLOWER]: Leader election won for term 1
14:24:13.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.083956 15867 raft_consensus.cc:697] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [term 1 LEADER]: Becoming Leader. State: Replica: bdfd7eced1c04c908db986bed9eaac3d, State: Running, Role: LEADER
14:24:13.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.086098 15867 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:13.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.035387 15704 master_runner.cc:187] Error getting master registration for 127.15.52.62:42455: OK, instance_id { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" instance_seqno: 1779114248616485 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:24:13.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.111434 15704 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:24:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.115399 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdfd7eced1c04c908db986bed9eaac3d. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.116240 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: This master's current role is: LEADER
14:24:13.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.123462 15897 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:24:13.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.131160 15897 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:24:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.158782 15752 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [term 1 FOLLOWER]: Refusing update from remote peer bdfd7eced1c04c908db986bed9eaac3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:24:13.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.160395 15867 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:13.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.190835 15898 mvcc.cc:204] Tried to move back new op lower bound from 7287251980918919168 to 7287251980660117504. Current Snapshot: MvccSnapshot[applied={T|T < 7287251980918919168}]
14:24:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.194221 15882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdfd7eced1c04c908db986bed9eaac3d. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.195776 15882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.197322 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.198105 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: This master's current role is: LEADER
14:24:13.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.201308 15897 catalog_manager.cc:1383] Generated new cluster ID: 7589974db91240acaf9ea4a75a9e1d62
14:24:13.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.201654 15897 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:24:13.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.214110 15902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.214789 15902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.232249 15897 catalog_manager.cc:1406] Generated new certificate authority record
14:24:13.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.234217 15897 catalog_manager.cc:1540] Loading token signing keys...
14:24:13.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.267409 15897 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d: Generated new TSK 0
14:24:13.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.268589 15897 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:24:13.272 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:13.272 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:13.273 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:13.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.273 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.287966 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/logs
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data/info.pb
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.1:0
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.1
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.1
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:13.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:13.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:13.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:13.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:13.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114253306 for job 77d052e6e51b5ae35525074f80512696.
14:24:13.318 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:24:13.320 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:24:13.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.330514 15702 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } attempt: 7
14:24:13.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.368906 15702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: Bootstrap starting.
14:24:13.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.391391 15702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: Neither blocks nor log segments found. Creating new log.
14:24:13.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.398057 15702 log.cc:826] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: Log is configured to *not* fsync() on all Append() calls
14:24:13.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.423318 15702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: No bootstrap required, opened a new log
14:24:13.450 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:13.450 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:13.450 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:13.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:13.452 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.452 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.452 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:13.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.452 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.452 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:13.452 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:13.471 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:13.471 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:13.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:13.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:13.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:13.472 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:13.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:13.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:13.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:13.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:13.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:13.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:13.472 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:13.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.528858 15702 raft_consensus.cc:359] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.531910 15702 raft_consensus.cc:385] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.532894 15702 raft_consensus.cc:740] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62f7d8cfb6c4d42996063d78ff7d179, State: Initialized, Role: FOLLOWER
14:24:13.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.535492 15702 consensus_queue.cc:260] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } }
14:24:13.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:13.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.563647 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd7eced1c04c908db986bed9eaac3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" is_pre_election: true
14:24:13.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.564512 15677 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdfd7eced1c04c908db986bed9eaac3d in term 0.
14:24:13.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.567138 15675 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 0 FOLLOWER]: Advancing to term 1
14:24:13.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.570477 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdfd7eced1c04c908db986bed9eaac3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62f7d8cfb6c4d42996063d78ff7d179"
14:24:13.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.577414 15675 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [term 1 FOLLOWER]: Refusing update from remote peer bdfd7eced1c04c908db986bed9eaac3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:24:13.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.578438 15656 tablet.cc:2404] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:13.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.579324 15895 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:13.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.562928 15907 sys_catalog.cc:455] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.588519 15907 sys_catalog.cc:458] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.587294 15702 sys_catalog.cc:565] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: configured and running, proceeding with master startup.
14:24:13.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:13.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.648018 15911 mvcc.cc:204] Tried to move back new op lower bound from 7287251980918919168 to 7287251980660117504. Current Snapshot: MvccSnapshot[applied={T|T < 7287251980918919168}]
14:24:13.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.683650 15907 sys_catalog.cc:455] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdfd7eced1c04c908db986bed9eaac3d. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.684382 15907 sys_catalog.cc:458] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.685957 15908 sys_catalog.cc:455] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:13.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.686761 15908 sys_catalog.cc:458] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179 [sys.catalog]: This master's current role is: FOLLOWER
14:24:13.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.732375 15924 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:24:13.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114253806 for job 77d052e6e51b5ae35525074f80512696.
14:24:13.819 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:24:13.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:24:13.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.882004 15904 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:13.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.882488 15904 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:13.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.883036 15904 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:13.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.915882 15904 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:13.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.916734 15904 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.52.1
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.952886 15904 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.1:0
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data/info.pb
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.1
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.1
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/logs
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:13.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.954471 15904 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:13.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:13.956125 15904 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:13.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.970041 15930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:14.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:14.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.049357 15893 catalog_manager.cc:1295] Loaded cluster ID: 7589974db91240acaf9ea4a75a9e1d62
14:24:14.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.050057 15893 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: loading cluster ID for follower catalog manager: success
14:24:14.057 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:14.057 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:14.058 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:14.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.058 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.058 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.058 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.059 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:14.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.066627 15893 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: acquiring CA information for follower catalog manager: success
14:24:14.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.079144 15893 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 310a4cf2ebb146eabc9fc7966b4be743: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:24:14.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:14.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.122476 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bdfd7eced1c04c908db986bed9eaac3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62f7d8cfb6c4d42996063d78ff7d179" member_type: VOTER last_known_addr { host: "127.15.52.62" port: 42455 } } peers { permanent_uuid: "310a4cf2ebb146eabc9fc7966b4be743" member_type: VOTER last_known_addr { host: "127.15.52.61" port: 40475 } } peers { permanent_uuid: "bdfd7eced1c04c908db986bed9eaac3d" member_type: VOTER last_known_addr { host: "127.15.52.60" port: 41453 } } }
14:24:14.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.126680 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfd7eced1c04c908db986bed9eaac3d [sys.catalog]: This master's current role is: LEADER
14:24:14.239 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:14.240 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:14.240 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:14.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.242 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.242 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.242 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:14.308 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114254307 for job 77d052e6e51b5ae35525074f80512696.
14:24:14.326 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
14:24:14.327 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:24:14.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:14.552 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:14.552 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:14.552 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:14.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.553 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:14.553 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.553 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:14.553 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:14.553 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:14.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:14.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:14.576 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.576 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:14.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.576 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.576 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.578 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:14.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:14.651 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:14.651 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:14.651 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:14.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.653 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:14.710 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:14.710 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:14.711 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:14.711 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:14.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:14.711 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:14.711 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:14.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:14.711 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:14.712 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:14.712 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:14.712 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:14.712 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:14.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.765197 15924 catalog_manager.cc:1295] Loaded cluster ID: 7589974db91240acaf9ea4a75a9e1d62
14:24:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.767264 15924 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: loading cluster ID for follower catalog manager: success
14:24:14.770 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:14.771 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:14.771 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:14.771 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:14.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:14.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:14.773 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:14.798 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:14.798 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:14.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:14.799 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:14.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:14.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:14.802 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:14.802 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:14.802 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:14.803 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:14.803 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:14.803 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:14.803 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:14.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114254806 for job 77d052e6e51b5ae35525074f80512696.
14:24:14.831 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:24:14.832 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:24:14.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.868084 15924 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: acquiring CA information for follower catalog manager: success
14:24:14.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:14.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:14.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:14.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:14.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:14.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:14.896 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:14.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:14.901465 15924 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a62f7d8cfb6c4d42996063d78ff7d179: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:24:15.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:15.082 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:15.082 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:15.083 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:15.083 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.083 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.083 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.084 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.085 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:15.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:15.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114255306 for job 77d052e6e51b5ae35525074f80512696.
14:24:15.321 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:24:15.323 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:24:15.391 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:15.391 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:15.392 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:15.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:15.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:15.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:15.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:15.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:15.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:15.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:15.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:15.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:15.394 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:15.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:15.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.374343 15929 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 15904
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.776070 15929 kernel_stack_watchdog.cc:198] Thread 15904 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:24:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:13.973523 15931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:15.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.778685 15933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.782307 15932 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1810 milliseconds
14:24:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.782896 15904 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.811s	user 0.582s	sys 0.887s
14:24:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:15.783186 15904 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.811s	user 0.582s	sys 0.887s
14:24:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.783470 15904 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:15.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.784773 15904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:15.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.803653 15904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:15.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114255806 for job 77d052e6e51b5ae35525074f80512696.
14:24:15.812 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:15.812 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:15.812 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:15.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.811170 15904 hybrid_clock.cc:648] HybridClock initialized: now 1779114255811119 us; error 42 us; skew 500 ppm
14:24:15.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.812255 15904 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:15.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:15.814 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.814 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.814 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:15.814 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.814 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:15.815 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:15.819 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:24:15.821 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:24:15.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.846705 15904 webserver.cc:533] Webserver started at http://127.15.52.1:32817/ using document root <none> and password file <none>
14:24:15.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.848124 15904 fs_manager.cc:362] Metadata directory not provided
14:24:15.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.848527 15904 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:15.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.849179 15904 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:15.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.856619 15904 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data/instance:
14:24:15.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03dc834ad6514e3387738f0060b29612"
14:24:15.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:15 on dist-test-slave-1n46"
14:24:15.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.858359 15904 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal/instance:
14:24:15.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03dc834ad6514e3387738f0060b29612"
14:24:15.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:15 on dist-test-slave-1n46"
14:24:15.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.879961 15904 fs_manager.cc:696] Time spent creating directory manager: real 0.021s	user 0.012s	sys 0.006s
14:24:15.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.892735 15949 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:15.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.893950 15904 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.000s	sys 0.009s
14:24:15.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.894335 15904 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal
14:24:15.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03dc834ad6514e3387738f0060b29612"
14:24:15.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:15 on dist-test-slave-1n46"
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:15.894750 15904 fs_report.cc:389] FS layout report
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data/data
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:15.975 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:15.975 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:15.975 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:15.975 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:15.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:15.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:15.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:15.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:15.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:15.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:15.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:15.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:15.976 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:16.015 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:16.015 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:16.015 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:16.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.017 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.017 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.017 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:16.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.018429 15904 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:16.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.020195 15904 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:16.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.020726 15904 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:16.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.029908 15904 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:16.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:16.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.047132 15904 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:16.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.047390 15904 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:16.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.047684 15904 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:16.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.047925 15904 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:16.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:16.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114256306 for job 77d052e6e51b5ae35525074f80512696.
14:24:16.317 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:24:16.318 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:24:16.478 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:16.479 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:16.479 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:16.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.479 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.479 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.479 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.479 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.479 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.479 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.479 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.479 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:16.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.550699 16061 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.1:34821 every 8 connection(s)
14:24:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.551065 15904 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.1:34821
14:24:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.554231 15904 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/data/info.pb
14:24:16.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.563131 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 15904
14:24:16.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.563648 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-0/wal/instance
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.577761 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/logs
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data/info.pb
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.2:0
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.2
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.2
14:24:16.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:16.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.655165 16062 heartbeater.cc:344] Connected to a master server at 127.15.52.60:41453
14:24:16.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.655669 16062 heartbeater.cc:461] Registering TS with master...
14:24:16.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.656982 16062 heartbeater.cc:507] Master 127.15.52.60:41453 requested a full tablet report, sending...
14:24:16.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.659966 15823 ts_manager.cc:194] Registered new tserver with Master: 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821)
14:24:16.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.662672 15823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.52.1:38009
14:24:16.675 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:16.675 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:16.675 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:16.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.676 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.677 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.677 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:16.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.678267 16063 heartbeater.cc:344] Connected to a master server at 127.15.52.61:40475
14:24:16.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.678642 16063 heartbeater.cc:461] Registering TS with master...
14:24:16.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.679266 16063 heartbeater.cc:507] Master 127.15.52.61:40475 requested a full tablet report, sending...
14:24:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.682077 15742 ts_manager.cc:194] Registered new tserver with Master: 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821)
14:24:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.684799 16067 heartbeater.cc:344] Connected to a master server at 127.15.52.62:42455
14:24:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.685115 16067 heartbeater.cc:461] Registering TS with master...
14:24:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.685710 16067 heartbeater.cc:507] Master 127.15.52.62:42455 requested a full tablet report, sending...
14:24:16.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:16.688189 15667 ts_manager.cc:194] Registered new tserver with Master: 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821)
14:24:16.717 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:16.718 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:16.718 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:16.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:16.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:16.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:16.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:16.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:16.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:16.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:16.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:16.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:16.719 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:16.758 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:16.759 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:16.759 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:16.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.759 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.759 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:16.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:16.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:16.761 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:16.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114256806 for job 77d052e6e51b5ae35525074f80512696.
14:24:16.815 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:16.816 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:24:17.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.028503 16066 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:17.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.028959 16066 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:17.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.029423 16066 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:17.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:17.052 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:17.052 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:17.052 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:17.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.053 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.053 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.053 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.053 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.053 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.053 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.053 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:17.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.063293 16066 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.064123 16066 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.52.2
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:17.100135 16066 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.2:0
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data/info.pb
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.2
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.2
14:24:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/logs
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:17.101642 16066 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:17.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:17.103288 16066 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:17.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:17.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.119689 16081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:17.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114257306 for job 77d052e6e51b5ae35525074f80512696.
14:24:17.319 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:17.319 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:17.320 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:17.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.321 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.321 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.321 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.321 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.321 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.322 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.322 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:17.324 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:24:17.325 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:24:17.352 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:17.352 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:17.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.352 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:17.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.353 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.353 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:17.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:17.609 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:17.638 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:17.639 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:17.639 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:17.639 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:17.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.639 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:17.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.639 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:17.640 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:17.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:17.666313 16062 heartbeater.cc:499] Master 127.15.52.60:41453 was elected leader, sending a full tablet report...
14:24:17.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:17.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:17.783 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:17.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.783 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.783 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.783 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.783 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:17.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114257806 for job 77d052e6e51b5ae35525074f80512696.
14:24:17.820 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:24:17.822 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:24:17.850 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:17.850 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:17.850 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:17.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.852 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.852 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.852 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.853 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:17.894 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:17.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:17.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:17.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:17.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:17.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:17.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:17.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:17.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:17.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:17.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:17.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:17.897 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:17.991 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:17.991 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:17.991 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:17.992 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.992 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.993 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:17.993 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.993 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.993 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:17.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.994 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:17.994 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:18.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:18.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:18.131 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:18.131 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:18.131 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:18.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.132 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.132 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.132 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.132 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.132 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.132 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.132 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.132 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:18.212 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:18.212 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:18.212 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:18.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:18.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:18.213 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.213 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.213 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:18.213 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:18.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114258307 for job 77d052e6e51b5ae35525074f80512696.
14:24:18.318 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:24:18.319 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:24:18.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:17.120929 16080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:18.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:18.474241 16066 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.357s	user 0.423s	sys 0.874s
14:24:18.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:18.474749 16066 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.358s	user 0.423s	sys 0.874s
14:24:18.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.476312 16066 server_base.cc:1061] running on GCE node
14:24:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:18.477751 16086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:18.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.479305 16066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:18.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.482028 16066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.483512 16066 hybrid_clock.cc:648] HybridClock initialized: now 1779114258483456 us; error 32 us; skew 500 ppm
14:24:18.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.484711 16066 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:18.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.494038 16066 webserver.cc:533] Webserver started at http://127.15.52.2:38069/ using document root <none> and password file <none>
14:24:18.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.495375 16066 fs_manager.cc:362] Metadata directory not provided
14:24:18.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.495689 16066 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:18.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.496315 16066 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.503212 16066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data/instance:
14:24:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "867085016e264a24b5eae3438bda3c54"
14:24:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:18 on dist-test-slave-1n46"
14:24:18.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.504702 16066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal/instance:
14:24:18.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "867085016e264a24b5eae3438bda3c54"
14:24:18.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:18 on dist-test-slave-1n46"
14:24:18.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.514976 16066 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.002s
14:24:18.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.522311 16091 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:18.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.523568 16066 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.523918 16066 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "867085016e264a24b5eae3438bda3c54"
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:18 on dist-test-slave-1n46"
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.524307 16066 fs_report.cc:389] FS layout report
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal
14:24:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data/data
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:18.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:18.555 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:18.555 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:18.555 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:18.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:18.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:18.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:18.556 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:18.556 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:18.556 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:18.556 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:18.556 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:18.556 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:18.557 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:18.590 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:18.591 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:18.591 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:18.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:18.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:18.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:18.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:18.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:18.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:18.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:18.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:18.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:18.592 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:18.609 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:18.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.610124 16066 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:18.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.611490 16066 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.611937 16066 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:18.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.614396 16066 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.618235 16066 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.618402 16066 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.618578 16066 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.618690 16066 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:18.635 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:18.635 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:18.635 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:18.636 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.636 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.636 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.637 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.637 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:18.734 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:18.735 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:18.735 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:18.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.735 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.735 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:18.735 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:18.735 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.735 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.736 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:18.736 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:18.737 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:18.738 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:18.738 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:18.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:18.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:18.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:18.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:18.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:18.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:18.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:18.738 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:18.738 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:18.738 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:18.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.768491 16066 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.2:43157
14:24:18.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.768591 16203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.2:43157 every 8 connection(s)
14:24:18.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.771085 16066 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/data/info.pb
14:24:18.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.773267 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16066
14:24:18.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.773892 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-1/wal/instance
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.790398 15568 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/logs
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data/info.pb
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.3:0
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.3
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.3
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:18.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114258807 for job 77d052e6e51b5ae35525074f80512696.
14:24:18.819 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:24:18.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:24:18.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.820767 16205 heartbeater.cc:344] Connected to a master server at 127.15.52.61:40475
14:24:18.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.821301 16205 heartbeater.cc:461] Registering TS with master...
14:24:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.822614 16205 heartbeater.cc:507] Master 127.15.52.61:40475 requested a full tablet report, sending...
14:24:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.823671 16204 heartbeater.cc:344] Connected to a master server at 127.15.52.60:41453
14:24:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.823972 16204 heartbeater.cc:461] Registering TS with master...
14:24:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.824694 16204 heartbeater.cc:507] Master 127.15.52.60:41453 requested a full tablet report, sending...
14:24:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.825426 15742 ts_manager.cc:194] Registered new tserver with Master: 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:18.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.826491 15823 ts_manager.cc:194] Registered new tserver with Master: 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:18.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.827349 16206 heartbeater.cc:344] Connected to a master server at 127.15.52.62:42455
14:24:18.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.827736 16206 heartbeater.cc:461] Registering TS with master...
14:24:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.828226 15823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.52.2:54523
14:24:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.828554 16206 heartbeater.cc:507] Master 127.15.52.62:42455 requested a full tablet report, sending...
14:24:18.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:18.831138 15667 ts_manager.cc:194] Registered new tserver with Master: 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:19.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:19.051 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:19.052 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:19.052 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:19.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:19.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:19.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:19.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:19.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:19.052 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:19.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:19.052 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:19.052 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:19.052 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:19.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.123212 16214 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.123651 16214 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:19.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.124053 16214 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:19.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.155613 16214 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:19.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.156507 16214 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.52.3
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:19.195782 16214 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.52.20:46171
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.52.3:0
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data/info.pb
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.52.3
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.52.62:42455,127.15.52.61:40475,127.15.52.60:41453
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.52.3
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/logs
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:19.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:19.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:19.197005 16214 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:19.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:19.198911 16214 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:19.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.211272 16221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:19.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114259306 for job 77d052e6e51b5ae35525074f80512696.
14:24:19.323 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:24:19.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:24:19.331 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:19.332 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:19.332 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:19.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.333 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.333 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.333 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.334 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.334 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.334 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:19.410 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:19.411 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:19.411 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:19.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.412 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.412 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.412 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.412 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.412 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.412 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:19.430 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:19.431 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:19.431 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:19.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:19.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:19.431 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.432 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.432 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:19.432 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:19.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:19.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:19.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114259806 for job 77d052e6e51b5ae35525074f80512696.
14:24:19.820 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:24:19.821 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:24:19.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:19.832232 16204 heartbeater.cc:499] Master 127.15.52.60:41453 was elected leader, sending a full tablet report...
14:24:19.970 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:19.971 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:19.971 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:19.971 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.972 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:19.972 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.972 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.972 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:19.972 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.972 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.972 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:19.972 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:20.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:20.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:20.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114260306 for job 77d052e6e51b5ae35525074f80512696.
14:24:20.316 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:24:20.317 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:24:20.338 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:20.338 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:20.338 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:20.339 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:20.339 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:20.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:20.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:20.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:20.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:20.339 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:20.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:20.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:20.340 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:20.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:19.212633 16222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:20.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:20.465474 16224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:20.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:20.467744 16223 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1250 milliseconds
14:24:20.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.467880 16214 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:20.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.469159 16214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:20.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.471560 16214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:20.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.472986 16214 hybrid_clock.cc:648] HybridClock initialized: now 1779114260472954 us; error 50 us; skew 500 ppm
14:24:20.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.473816 16214 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.479956 16214 webserver.cc:533] Webserver started at http://127.15.52.3:41229/ using document root <none> and password file <none>
14:24:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.480885 16214 fs_manager.cc:362] Metadata directory not provided
14:24:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.481112 16214 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.481544 16214 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:20.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.486493 16214 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data/instance:
14:24:20.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e4dbc1022b094e258f077442852021f9"
14:24:20.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:20 on dist-test-slave-1n46"
14:24:20.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.487560 16214 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal/instance:
14:24:20.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e4dbc1022b094e258f077442852021f9"
14:24:20.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:20 on dist-test-slave-1n46"
14:24:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.494629 16214 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
14:24:20.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.500559 16231 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:20.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.501536 16214 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.501863 16214 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e4dbc1022b094e258f077442852021f9"
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:20 on dist-test-slave-1n46"
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.502267 16214 fs_report.cc:389] FS layout report
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data/data
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:20.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:20.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:20.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:20.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:20.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:20.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.549721 16214 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.551187 16214 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.551687 16214 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:20.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.554989 16214 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:20.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.559273 16214 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:20.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.559460 16214 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:20.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.559715 16214 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:20.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.559864 16214 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:20.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:20.622 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:20.622 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:20.622 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:20.623 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.623 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.623 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.623 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.623 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.624 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:20.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.722697 16214 rpc_server.cc:307] RPC server started. Bound to: 127.15.52.3:41829
14:24:20.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.722816 16343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.52.3:41829 every 8 connection(s)
14:24:20.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.725411 16214 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/data/info.pb
14:24:20.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.729743 15568 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16214
14:24:20.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.730306 15568 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15913011835378951279/ts-2/wal/instance
14:24:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.769018 16346 heartbeater.cc:344] Connected to a master server at 127.15.52.62:42455
14:24:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.769357 16345 heartbeater.cc:344] Connected to a master server at 127.15.52.61:40475
14:24:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.769487 16346 heartbeater.cc:461] Registering TS with master...
14:24:20.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.769732 16345 heartbeater.cc:461] Registering TS with master...
14:24:20.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.770859 16345 heartbeater.cc:507] Master 127.15.52.61:40475 requested a full tablet report, sending...
14:24:20.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.770869 16346 heartbeater.cc:507] Master 127.15.52.62:42455 requested a full tablet report, sending...
14:24:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.773257 16344 heartbeater.cc:344] Connected to a master server at 127.15.52.60:41453
14:24:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.773568 16344 heartbeater.cc:461] Registering TS with master...
14:24:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.774224 15742 ts_manager.cc:194] Registered new tserver with Master: e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.774363 16344 heartbeater.cc:507] Master 127.15.52.60:41453 requested a full tablet report, sending...
14:24:20.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.776453 15822 ts_manager.cc:194] Registered new tserver with Master: e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:20.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.777716 15667 ts_manager.cc:194] Registered new tserver with Master: e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:20.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.778223 15822 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.52.3:51197
14:24:20.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:20.795046 15568 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:24:20.806 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:24:20.806 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:24:20.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114260806 for job 77d052e6e51b5ae35525074f80512696.
14:24:20.808 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.52.62"
      port: 42455
    }
    bound_http_address {
      host: "127.15.52.62"
      port: 38451
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.52.61"
      port: 40475
    }
    bound_http_address {
      host: "127.15.52.61"
      port: 41623
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.52.60"
      port: 41453
    }
    bound_http_address {
      host: "127.15.52.60"
      port: 43199
    }
  }
}

14:24:20.808 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:24:20.809 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.52.1"
      port: 34821
    }
    bound_http_address {
      host: "127.15.52.1"
      port: 32817
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.52.2"
      port: 43157
    }
    bound_http_address {
      host: "127.15.52.2"
      port: 38069
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.52.3"
      port: 41829
    }
    bound_http_address {
      host: "127.15.52.3"
      port: 41229
    }
  }
}

14:24:20.809 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:24:20.811 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:20.811 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:24:20.811 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:24:20.811 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:24:20.811 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:24:20.814 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:20.815 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:24:20.815 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:24:20.991 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:20.991 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:20.992 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:20.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.992 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.992 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.992 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.992 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:20.992 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:20.992 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:20.992 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:20.993 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [37ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [48ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [67ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [72ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [76ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [106ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [106ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [471ms] refreshing cache from master, [471ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [474ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [474ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [863ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [863ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1504ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2744ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2745ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2745ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4884ms] refreshing cache from master, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4885ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4885ms] too many traces: truncated at 100 traces, deferred=Deferred@1457950482(state=PENDING, result=null, callback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426), errback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426)))
14:24:20.994 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:24:20.994 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [37ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [48ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [67ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [72ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [76ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [106ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [106ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [471ms] refreshing cache from master, [471ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [474ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [474ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [863ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [863ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1504ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2744ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2745ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2745ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4884ms] refreshing cache from master, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4885ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4885ms] too many traces: truncated at 100 traces, deferred=Deferred@1457950482(state=PENDING, result=null, callback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426), errback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:20.994 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:24:20.996 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:24:20.999 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [37ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [48ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [48ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [67ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [72ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [76ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [106ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [106ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [471ms] refreshing cache from master, [471ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [473ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [474ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [474ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [862ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [863ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [863ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1504ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2744ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2745ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2745ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4884ms] refreshing cache from master, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4884ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4885ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4885ms] too many traces: truncated at 100 traces, deferred=Deferred@1457950482(state=PENDING, result=null, callback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426), errback=(continuation of Deferred@1865562337 after retry RPC after error@1343996442) -> (continuation of Deferred@1011908534 after retry RPC after error@1580001585) -> (continuation of Deferred@539436837 after retry RPC after error@773990953) -> (continuation of Deferred@296770964 after retry RPC after error@686574578) -> (continuation of Deferred@829116357 after retry RPC after error@245848227) -> (continuation of Deferred@501803038 after retry RPC after error@1469158282) -> (continuation of Deferred@1022356442 after retry RPC after error@138006180) -> (continuation of Deferred@1380675493 after retry RPC after error@161328037) -> (continuation of Deferred@1248800887 after retry RPC after error@207981424) -> (continuation of Deferred@89844510 after retry RPC after error@1644083347) -> (continuation of Deferred@1386332243 after retry RPC after error@1916796796) -> (continuation of Deferred@544208958 after retry RPC after error@876738176) -> (continuation of Deferred@1757289219 after retry RPC after error@1702354295) -> (continuation of Deferred@973498351 after retry RPC after error@21521369) -> (continuation of Deferred@422975216 after retry RPC after error@1123155140) -> (continuation of Deferred@1270989418 after retry RPC after error@156575328) -> (continuation of Deferred@553463852 after retry RPC after error@1839726379) -> (continuation of Deferred@682668647 after retry RPC after error@142010167) -> (continuation of Deferred@1103350341 after retry RPC after error@332344305) -> (continuation of Deferred@1052872805 after retry RPC after error@20027349) -> (continuation of Deferred@1585439828 after retry RPC after error@872795337) -> (continuation of Deferred@116732052 after retry RPC after error@200773792) -> (continuation of Deferred@713787598 after retry RPC after error@821193426)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:21.000 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:21.000 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
14:24:21.002 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:24:21.002 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:24:21.003 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
14:24:21.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:21.147 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:24:21.147 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:24:21.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.149719 16354 mini_oidc.cc:150] Starting JWKS server
14:24:21.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.152868 16354 webserver.cc:533] Webserver started at http://127.0.0.1:41231/ using document root <none> and password file <none>
14:24:21.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.153200 16354 mini_oidc.cc:186] Starting OIDC Discovery server
14:24:21.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.154819 16354 webserver.cc:533] Webserver started at http://127.0.0.1:36457/ using document root <none> and password file <none>
14:24:21.158 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:21.158 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:21.158 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:21.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:21.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:21.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:21.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:21.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:21.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:21.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:21.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:21.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:21.159 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:21.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:24:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:21Z Disabled control of system clock
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.214854 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/logs
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data/info.pb
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.190:44713
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.190
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json with env {}
14:24:21.251 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:21.252 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:21.252 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:21.252 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.252 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.252 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.252 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.253 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.253 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.253 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:21.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114261306 for job 77d052e6e51b5ae35525074f80512696.
14:24:21.314 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:21.315 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:24:21.410 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:21.410 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:21.411 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:21.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.411 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:21.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.509240 16367 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:21.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.509889 16367 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:21.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.510478 16367 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.541402 16367 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.541642 16367 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.541839 16367 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:21.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.542096 16367 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:21.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.542310 16367 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:21.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.542457 16367 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41231/jwks.json
14:24:21.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.580617 16367 master_runner.cc:387] Master server non-default flags:
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.190:44713
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data/info.pb
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.190
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/logs
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:21.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.582058 16367 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:21.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.583964 16367 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:21.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.596093 16373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:21.609 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:21.610 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:21.610 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:21.611 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:21.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.612 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.612 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.612 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.612 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.612 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:21.613 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=28788), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [18ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [18ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [66ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [107ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [107ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [249ms] refreshing cache from master, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [250ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [253ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [465ms] refreshing cache from master, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [466ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [467ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2025ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1542107344(state=PENDING, result=null, callback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262), errback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262)))
14:24:21.614 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:24:21.614 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=28788), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [18ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [18ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [66ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [107ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [107ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [249ms] refreshing cache from master, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [250ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [253ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [465ms] refreshing cache from master, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [466ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [467ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2025ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1542107344(state=PENDING, result=null, callback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262), errback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:21.615 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:24:21.617 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:24:21.619 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=28788), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [18ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [18ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [37ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [66ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [107ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [107ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [126ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [204ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [249ms] refreshing cache from master, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [250ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [252ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [253ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [465ms] refreshing cache from master, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [466ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [467ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [467ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2025ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1542107344(state=PENDING, result=null, callback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262), errback=(continuation of Deferred@1679890432 after retry RPC after error@1636180551) -> (continuation of Deferred@2014557733 after retry RPC after error@1987179975) -> (continuation of Deferred@444338705 after retry RPC after error@1253613315) -> (continuation of Deferred@796895983 after retry RPC after error@1457110282) -> (continuation of Deferred@751812954 after retry RPC after error@570495815) -> (continuation of Deferred@1895558458 after retry RPC after error@1800482754) -> (continuation of Deferred@960952035 after retry RPC after error@334975399) -> (continuation of Deferred@1011543262 after retry RPC after error@1585965994) -> (continuation of Deferred@1358495607 after retry RPC after error@2041312934) -> (continuation of Deferred@309123409 after retry RPC after error@1943517709) -> (continuation of Deferred@1690562631 after retry RPC after error@1115366591) -> (continuation of Deferred@917097456 after retry RPC after error@2019559674) -> (continuation of Deferred@56266361 after retry RPC after error@404687985) -> (continuation of Deferred@1611772617 after retry RPC after error@407785961) -> (continuation of Deferred@1336946143 after retry RPC after error@791469276) -> (continuation of Deferred@1120318474 after retry RPC after error@686650530) -> (continuation of Deferred@1727888053 after retry RPC after error@805212298) -> (continuation of Deferred@1483675547 after retry RPC after error@459546704) -> (continuation of Deferred@373410139 after retry RPC after error@1306550745) -> (continuation of Deferred@1838380081 after retry RPC after error@1464840051) -> (continuation of Deferred@1339867088 after retry RPC after error@24961371) -> (continuation of Deferred@2000175033 after retry RPC after error@1562780186) -> (continuation of Deferred@1999512657 after retry RPC after error@289306070) -> (continuation of Deferred@667768255 after retry RPC after error@1259832750) -> (continuation of Deferred@1302146097 after retry RPC after error@795828369) -> (continuation of Deferred@1656928366 after retry RPC after error@353336173) -> (continuation of Deferred@836186457 after retry RPC after error@1701356570) -> (continuation of Deferred@303980817 after retry RPC after error@2082776108) -> (continuation of Deferred@1953570568 after retry RPC after error@1410940392) -> (continuation of Deferred@904845459 after retry RPC after error@1815224262)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:21.620 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:21.627 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
14:24:21.627 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:24:21.736 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:21.737 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:21.737 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:21.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.738 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:21.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.739 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:21.739 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.739 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:21.739 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:21.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:21.781881 16344 heartbeater.cc:499] Master 127.15.52.60:41453 was elected leader, sending a full tablet report...
14:24:21.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114261806 for job 77d052e6e51b5ae35525074f80512696.
14:24:21.819 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:24:21.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:24:21.871 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:21.872 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:21.872 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:21.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:21.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:21.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:21.873 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:21.874 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29049), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [32ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [75ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [104ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [124ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [245ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [247ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [247ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [503ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1007ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1102ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2844ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [5100ms] refreshing cache from master, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5101ms] too many traces: truncated at 100 traces, deferred=Deferred@1724807114(state=PENDING, result=null, callback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315), errback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315)))
14:24:21.875 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:24:21.875 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29049), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [32ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [75ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [104ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [124ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [245ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [247ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [247ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [503ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1007ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1102ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2844ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [5100ms] refreshing cache from master, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5101ms] too many traces: truncated at 100 traces, deferred=Deferred@1724807114(state=PENDING, result=null, callback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315), errback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.61:45967
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:21.876 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
14:24:21.879 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:24:21.882 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29049), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [32ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [75ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [104ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [124ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [245ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [247ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [247ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [503ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1006ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1007ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1102ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2844ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [5100ms] refreshing cache from master, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5101ms] too many traces: truncated at 100 traces, deferred=Deferred@1724807114(state=PENDING, result=null, callback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315), errback=(continuation of Deferred@1051909668 after retry RPC after error@198602680) -> (continuation of Deferred@1636778670 after retry RPC after error@1961494898) -> (continuation of Deferred@1543612981 after retry RPC after error@1687332258) -> (continuation of Deferred@2140340652 after retry RPC after error@1536566965) -> (continuation of Deferred@177700848 after retry RPC after error@2077848757) -> (continuation of Deferred@471897091 after retry RPC after error@1986636476) -> (continuation of Deferred@1202729854 after retry RPC after error@2013039585) -> (continuation of Deferred@1877252497 after retry RPC after error@1424220827) -> (continuation of Deferred@311296186 after retry RPC after error@20849289) -> (continuation of Deferred@1247615790 after retry RPC after error@31580100) -> (continuation of Deferred@1661502610 after retry RPC after error@332580880) -> (continuation of Deferred@838087983 after retry RPC after error@1055183658) -> (continuation of Deferred@435154032 after retry RPC after error@477639957) -> (continuation of Deferred@213198584 after retry RPC after error@349227463) -> (continuation of Deferred@1916418881 after retry RPC after error@792160398) -> (continuation of Deferred@177211766 after retry RPC after error@404514578) -> (continuation of Deferred@1004517219 after retry RPC after error@792255374) -> (continuation of Deferred@627682470 after retry RPC after error@1589017582) -> (continuation of Deferred@404007924 after retry RPC after error@1905911763) -> (continuation of Deferred@436042202 after retry RPC after error@1962481664) -> (continuation of Deferred@1225741920 after retry RPC after error@1997969389) -> (continuation of Deferred@97977212 after retry RPC after error@961688286) -> (continuation of Deferred@173924290 after retry RPC after error@1228380315)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.61:45967
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:21.883 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:21.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
14:24:21.884 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:24:22.015 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:22.015 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:22.016 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:22.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:22.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:22.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:22.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:22.016 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:22.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:22.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:22.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:22.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:22.016 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:22.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:22.194 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:22.195 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:22.195 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:22.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.196 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.196 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:22.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114262306 for job 77d052e6e51b5ae35525074f80512696.
14:24:22.318 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:24:22.319 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:24:22.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.351 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.352 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.353 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.353 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.354 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29528), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [11ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [244ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [247ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [247ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [467ms] refreshing cache from master, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [469ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [469ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [920ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [923ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1523ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3263ms] refreshing cache from master, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3265ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [5280ms] refreshing cache from master, [5280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5282ms] too many traces: truncated at 100 traces, deferred=Deferred@187606656(state=PENDING, result=null, callback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188), errback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188)))
14:24:22.355 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.355 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.355 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.356 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.356 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.356 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.356 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.356 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.355 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29528), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [11ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [244ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [247ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [247ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [467ms] refreshing cache from master, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [469ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [469ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [920ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [923ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1523ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3263ms] refreshing cache from master, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3265ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [5280ms] refreshing cache from master, [5280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5282ms] too many traces: truncated at 100 traces, deferred=Deferred@187606656(state=PENDING, result=null, callback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188), errback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29528), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [11ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [244ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [247ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [247ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [467ms] refreshing cache from master, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [469ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [469ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [920ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [923ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1523ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3263ms] refreshing cache from master, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3265ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [5280ms] refreshing cache from master, [5280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5282ms] too many traces: truncated at 100 traces, deferred=Deferred@187606656(state=PENDING, result=null, callback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188), errback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:22.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.357 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.356 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.357 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.362 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29528), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [11ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [244ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [247ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [247ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [467ms] refreshing cache from master, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [469ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [469ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [920ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [923ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1523ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3263ms] refreshing cache from master, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3265ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [5280ms] refreshing cache from master, [5280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5282ms] too many traces: truncated at 100 traces, deferred=Deferred@187606656(state=PENDING, result=null, callback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188), errback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29528), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [11ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [244ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [247ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [247ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [467ms] refreshing cache from master, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [467ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [468ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [469ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [469ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [920ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [923ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1523ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3263ms] refreshing cache from master, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3264ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3265ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [5280ms] refreshing cache from master, [5280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5282ms] too many traces: truncated at 100 traces, deferred=Deferred@187606656(state=PENDING, result=null, callback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188), errback=(continuation of Deferred@849226591 after retry RPC after error@107817860) -> (continuation of Deferred@1035705222 after retry RPC after error@1138700311) -> (continuation of Deferred@5783520 after retry RPC after error@1871058276) -> (continuation of Deferred@243324089 after retry RPC after error@887423734) -> (continuation of Deferred@1963170997 after retry RPC after error@712084036) -> (continuation of Deferred@576501423 after retry RPC after error@1051914912) -> (continuation of Deferred@1463625719 after retry RPC after error@1907926270) -> (continuation of Deferred@915840424 after retry RPC after error@521686568) -> (continuation of Deferred@564445347 after retry RPC after error@353308477) -> (continuation of Deferred@402041833 after retry RPC after error@1254284849) -> (continuation of Deferred@1298447890 after retry RPC after error@545207908) -> (continuation of Deferred@49571937 after retry RPC after error@1578835288) -> (continuation of Deferred@912764071 after retry RPC after error@1878155289) -> (continuation of Deferred@1315220198 after retry RPC after error@1209245615) -> (continuation of Deferred@1134166174 after retry RPC after error@1058292316) -> (continuation of Deferred@1422720194 after retry RPC after error@16187155) -> (continuation of Deferred@326861155 after retry RPC after error@241186802) -> (continuation of Deferred@1031397392 after retry RPC after error@172007115) -> (continuation of Deferred@1165977209 after retry RPC after error@1244595843) -> (continuation of Deferred@941889206 after retry RPC after error@907829695) -> (continuation of Deferred@141465003 after retry RPC after error@977764667) -> (continuation of Deferred@583967075 after retry RPC after error@2005548316) -> (continuation of Deferred@196423051 after retry RPC after error@226311071) -> (continuation of Deferred@1517246186 after retry RPC after error@2091639398) -> (continuation of Deferred@1590710541 after retry RPC after error@974469259) -> (continuation of Deferred@451797285 after retry RPC after error@972458188)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:22.363 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:24:22.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
14:24:22.365 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
14:24:22.366 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:24:22.366 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
14:24:22.366 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:24:22.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:24:22.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
14:24:22.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:24:22.370 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.370 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.370 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.370 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.371 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.371 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.371 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:24:22.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.371 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
14:24:22.371 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.372 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:24:22.390 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.390 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.390 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.391 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.391 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.391 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.392 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.392 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.410 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.410 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.410 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.411 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.413 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.413 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.414 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.431 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.431 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.431 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.432 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.432 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.432 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.432 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.432 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.432 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.432 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.447 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:24:22.447 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:24:22.448 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:24:22.449 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:24:22.449 [INFO - Thread-30] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:24:22.449 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
14:24:22.451 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:22.452 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
14:24:22.452 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:24:22.452 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
14:24:22.453 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:24:22.453 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
14:24:22.453 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:24:22.454 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
14:24:22.454 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:22.454 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:22.454 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
14:24:22.454 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:24:22.455 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
14:24:22.455 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:24:22.455 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
14:24:22.455 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:24:22.456 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:22.450 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:24:22.456 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:24:22.456 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:24:22.456 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:24:22.457 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.457 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.457 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.458 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:24:22.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.458 [DEBUG - Thread-30] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:22.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.459 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.459 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.459 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.459 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.459 [WARN - kudu-nio-2] (AsyncKuduClient.java:2800) Failed to schedule timer. Ignore this if we're shutting down.
java.lang.IllegalStateException: cannot be started once stopped
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer.start(HashedWheelTimer.java:363)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer.newTimeout(HashedWheelTimer.java:445)
	at org.apache.kudu.client.AsyncKuduClient.newTimeout(AsyncKuduClient.java:2795)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2343)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:22.460 [INFO - Thread-30] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:24:22.460 [INFO - Thread-30] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:24:22.461 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
14:24:22.461 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
14:24:22.463 [DEBUG - Thread-30] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:22.463 [INFO - Thread-30] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:22.463 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:24:22.464 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:24:22.465 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:22.465 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:22.465 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:22.465 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:22.465 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@30a6dce6
14:24:22.465 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:22.466 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:22.466 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
14:24:22.466 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
14:24:22.467 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6536566b
14:24:22.467 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:24:22.468 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:24:22.468 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:22.469 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:22.470 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
14:24:22.470 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:24:22.470 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:24:22.470 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:24:22.471 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
14:24:22.471 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13d9bfeb
14:24:22.472 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:22.472 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:22.472 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:24:22.472 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:24:22.476 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@36aa425c
14:24:22.477 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:24:22.479 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:22.480 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
14:24:22.481 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
14:24:22.481 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2da08d3c
14:24:22.481 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:22.482 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:22.482 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:24:22.482 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:24:22.486 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d1fa6c0
14:24:22.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@322fbbbe
14:24:22.489 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.489 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:22.495 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:22.495 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4896a219
14:24:22.498 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:22.500 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.502 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.502 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.506 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.508 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.508 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.509 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.510 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.511 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.512 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.512 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.513 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.515 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.515 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.517 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.517 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.517 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.517 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.518 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.518 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.518 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.518 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.519 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.519 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.519 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.520 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.520 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.520 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.520 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.521 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.521 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.523 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.524 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.526 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.526 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.527 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.527 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.527 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.530 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.530 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.533 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.534 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.535 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.539 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.540 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.540 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.540 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.542 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.542 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.543 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.544 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.546 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.550 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.554 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.554 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.555 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.556 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.566 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.567 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.567 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.567 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.567 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.568 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.568 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.568 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.568 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.568 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.568 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.569 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.569 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.571 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.573 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.573 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.574 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.574 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.574 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.575 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.575 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.575 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.576 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.578 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.579 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.579 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.581 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.581 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.581 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.582 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.582 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.582 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.582 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.582 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.582 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.582 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.584 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.584 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.585 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.585 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.585 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.585 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.585 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.589 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.589 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.589 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.589 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.590 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.590 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.590 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.590 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.591 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.594 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.594 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.594 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.594 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.596 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.598 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.602 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.602 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.603 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.603 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.604 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.605 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.606 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.609 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.609 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.609 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.609 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.610 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.610 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.610 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.613 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:22.609 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.613 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.614 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.614 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.614 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.616 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.616 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.616 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.617 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.621 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.621 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.621 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.622 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.624 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.625 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.625 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.626 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.633 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.633 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.633 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.633 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.633 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.633 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.633 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.633 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.633 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.633 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.640 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.641 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.641 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.642 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.642 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.642 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.642 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.649 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.649 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.649 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.649 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.650 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.650 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.650 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.650 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.650 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.649 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.650 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.651 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.651 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.651 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.652 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.653 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.653 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.654 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.654 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.654 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.655 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.669 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.670 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.670 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.670 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.670 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.670 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.672 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.672 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.672 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.673 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.673 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.690 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.690 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.690 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.690 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.690 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.691 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.691 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.692 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.692 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.692 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.693 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.693 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.709 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.709 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.710 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.710 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.710 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.710 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.711 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.713 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.713 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.713 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.714 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.721 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.721 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.721 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.722 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.722 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.722 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.722 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.722 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.722 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.723 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.729 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.729 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.729 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.729 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.729 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.729 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.730 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.730 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.730 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.730 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.730 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.731 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.732 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.732 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.733 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.733 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.761 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:22.761 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:22.761 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:22.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.762 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:22.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:22.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:22.763 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:22.769 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.769 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.770 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.770 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.770 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.770 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.770 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.770 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.782 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.783 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.784 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29972), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [63ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [84ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [259ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [463ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [464ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [464ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [464ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [504ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1062ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1603ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5161ms] refreshing cache from master, [5162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5163ms] too many traces: truncated at 100 traces, [5163ms] too many traces: truncated at 100 traces, deferred=Deferred@1884569945(state=PENDING, result=null, callback=(continuation of Deferred@105610814 after retry RPC after error@1607004371) -> (continuation of Deferred@1869046564 after retry RPC after error@1030465816) -> (continuation of Deferred@1619823109 after retry RPC after error@2019209391) -> (continuation of Deferred@753959619 after retry RPC after error@1278467372) -> (continuation of Deferred@1215015437 after retry RPC after error@1696179303) -> (continuation of Deferred@1305990301 after retry RPC after error@534756022) -> (continuation of Deferred@175198338 after retry RPC after error@585365303) -> (continuation of Deferred@1365486794 after retry RPC after error@856401498) -> (continuation of Deferred@863901177 after retry RPC after error@244913902) -> (continuation of Deferred@1120988683 after retry RPC after error@747088253) -> (continuation of Deferred@1863688393 after retry RPC after error@704505251) -> (continuation of Deferred@1821959713 after retry RPC after error@2101700238) -> (continuation of Deferred@1066701319 after retry RPC after error@2030217387) -> (continuation of Deferred@1375793220 after retry RPC after error@69705116) -> (continuation of Deferred@523776949 after retry RPC after error@1939048201) -> (continuation of Deferred@642042863 after retry RPC after error@515336646) -> (continuation of Deferred@1087128638 after retry RPC after error@789063905) -> (continuation of Deferred@798197084 after retry RPC after error@172961841) -> (continuation of Deferred@679508210 after retry RPC after error@1184956963) -> (continuation of Deferred@1965803214 after retry RPC after error@102149858) -> (continuation of Deferred@771359034 after retry RPC after error@1669643964) -> (continuation of Deferred@1211242932 after retry RPC after error@2078334958) -> (continuation of Deferred@107934329 after retry RPC after error@1079631190) -> (continuation of Deferred@419337040 after retry RPC after error@1704730638), errback=(continuation of Deferred@105610814 after retry RPC after error@1607004371) -> (continuation of Deferred@1869046564 after retry RPC after error@1030465816) -> (continuation of Deferred@1619823109 after retry RPC after error@2019209391) -> (continuation of Deferred@753959619 after retry RPC after error@1278467372) -> (continuation of Deferred@1215015437 after retry RPC after error@1696179303) -> (continuation of Deferred@1305990301 after retry RPC after error@534756022) -> (continuation of Deferred@175198338 after retry RPC after error@585365303) -> (continuation of Deferred@1365486794 after retry RPC after error@856401498) -> (continuation of Deferred@863901177 after retry RPC after error@244913902) -> (continuation of Deferred@1120988683 after retry RPC after error@747088253) -> (continuation of Deferred@1863688393 after retry RPC after error@704505251) -> (continuation of Deferred@1821959713 after retry RPC after error@2101700238) -> (continuation of Deferred@1066701319 after retry RPC after error@2030217387) -> (continuation of Deferred@1375793220 after retry RPC after error@69705116) -> (continuation of Deferred@523776949 after retry RPC after error@1939048201) -> (continuation of Deferred@642042863 after retry RPC after error@515336646) -> (continuation of Deferred@1087128638 after retry RPC after error@789063905) -> (continuation of Deferred@798197084 after retry RPC after error@172961841) -> (continuation of Deferred@679508210 after retry RPC after error@1184956963) -> (continuation of Deferred@1965803214 after retry RPC after error@102149858) -> (continuation of Deferred@771359034 after retry RPC after error@1669643964) -> (continuation of Deferred@1211242932 after retry RPC after error@2078334958) -> (continuation of Deferred@107934329 after retry RPC after error@1079631190) -> (continuation of Deferred@419337040 after retry RPC after error@1704730638)))
14:24:22.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.793 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.793 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.794 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.795 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.808 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114262807 for job 77d052e6e51b5ae35525074f80512696.
14:24:22.809 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.809 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.809 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.810 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.810 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.810 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.811 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.811 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.811 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.812 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.812 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.817 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.820 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:24:22.821 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:24:22.834 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.834 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.834 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.834 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.835 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.835 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.835 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.835 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.835 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.835 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.835 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.835 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:22.909 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.909 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.910 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.910 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.910 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.910 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.910 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.910 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.910 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.911 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.912 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.912 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.912 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.912 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.912 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.913 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.913 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.913 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.913 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.918 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:22.919 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:22.919 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:22.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:22.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:22.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:22.920 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:22.929 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.931 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.931 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:22.953 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:22.954 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:22.954 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:22.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.954 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:22.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:22.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:22.955 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.000458 16372 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 16367
14:24:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.002287 16367 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.407s	user 0.554s	sys 0.843s
14:24:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:21.597054 16374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.002823 16367 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.408s	user 0.554s	sys 0.844s
14:24:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.011087 16367 server_base.cc:1061] running on GCE node
14:24:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.011271 16434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.012612 16367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:23.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.014961 16367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:23.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.016381 16367 hybrid_clock.cc:648] HybridClock initialized: now 1779114263016337 us; error 42 us; skew 500 ppm
14:24:23.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.017151 16367 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:23.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.023255 16367 webserver.cc:533] Webserver started at http://127.15.248.190:45371/ using document root <none> and password file <none>
14:24:23.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.024261 16367 fs_manager.cc:362] Metadata directory not provided
14:24:23.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.024480 16367 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:23.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.024935 16367 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.028995 16367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data/instance:
14:24:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24cee9bfc4ba46c7996d1b7a669e6b65"
14:24:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:23 on dist-test-slave-1n46"
14:24:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.030252 16367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal/instance:
14:24:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24cee9bfc4ba46c7996d1b7a669e6b65"
14:24:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:23 on dist-test-slave-1n46"
14:24:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.037752 16367 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
14:24:23.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.043490 16439 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:23.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.044641 16367 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.044910 16367 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24cee9bfc4ba46c7996d1b7a669e6b65"
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:23 on dist-test-slave-1n46"
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.045255 16367 fs_report.cc:389] FS layout report
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data/data
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:23.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:23.073 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.073 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.073 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.073 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.074 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.074 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.089 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.089 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.089 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.089 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.089 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.089 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.089 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.089 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.090 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.090 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.090 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.090 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.090 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.091562 16367 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:23.091 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.092 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.092 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.092 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.092 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.092 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.092 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.092 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.092 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.092 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.092 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.093338 16367 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:23.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.093679 16367 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:23.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:23.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.163570 16367 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.190:44713
14:24:23.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.163640 16491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.190:44713 every 8 connection(s)
14:24:23.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.166201 16367 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/data/info.pb
14:24:23.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.172228 16492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:23.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.176636 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16367
14:24:23.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.176977 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-0/wal/instance
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.180395 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/logs
14:24:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data/info.pb
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.189:37707
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.189
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:23.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json with env {}
14:24:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.183035 16492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } has no permanent_uuid. Determining permanent_uuid...
14:24:23.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.208858 16492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
14:24:23.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.211330 16442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.215559 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.229 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.230 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.230 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.230 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.230 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.230 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.230 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.230 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.231 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.231 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.231 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.231 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.232 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.231 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.249 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.250 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.250 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.250 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.250 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.250 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.250 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.250 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.250 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.250 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.250 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.250 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.250 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:23.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:23.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:23.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:23.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:23.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:23.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:23.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:23.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:23.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:23.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:23.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:23.262 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:23.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.265019 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 1
14:24:23.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.268985 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.272 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.273 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.273 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.273 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.273 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.273 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.273 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.273 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.273 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.306 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114263306 for job 77d052e6e51b5ae35525074f80512696.
14:24:23.314 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:23.314 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:24:23.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.337338 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 2
14:24:23.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.341820 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:23.412 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:23.412 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:23.412 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:23.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.413 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:23.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.433205 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 3
14:24:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.437206 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.472 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:23.472 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:23.472 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:23.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:23.473 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.473 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:23.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:23.474 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:23.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.506728 16494 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:23.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.507264 16494 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:23.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.507814 16494 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:23.515 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:23.515 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:23.515 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:23.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:23.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:23.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:23.516 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:23.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.539717 16494 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:23.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.540066 16494 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:23.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.540359 16494 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:23.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.540696 16494 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:23.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.540993 16494 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:23.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.541229 16494 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41231/jwks.json
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.577121 16494 master_runner.cc:387] Master server non-default flags:
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.189:37707
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data/info.pb
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.189
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/logs
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:23.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:23.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:23.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:23.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:23.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.578464 16494 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:23.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.580049 16494 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:23.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.580569 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 4
14:24:23.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.585263 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:23.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.592659 16503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:23.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:23.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114263806 for job 77d052e6e51b5ae35525074f80512696.
14:24:23.817 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:24:23.819 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:24:23.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:23.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:23.884678 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 5
14:24:23.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.892179 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:24.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:24.255 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:24.256 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:24.256 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:24.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.257 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.257 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:24.260 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:24.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:24.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:24.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:24.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:24.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:24.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:24.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:24.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:24.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:24.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:24.262 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:24.262 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:24.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114264306 for job 77d052e6e51b5ae35525074f80512696.
14:24:24.315 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:24.316 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:24:24.358 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:24.358 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:24.358 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:24.359 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:24.359 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:24.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:24.359 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:24.359 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:24.359 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:24.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:24.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:24.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:24.360 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:24.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:24.412 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:24.412 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:24.412 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:24.413 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.413 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:24.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:24.439798 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 6
14:24:24.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:24.451506 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.189:37707: Network error: Client connection negotiation failed: client connection to 127.15.248.189:37707: connect: Connection refused (error 111)
14:24:24.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:24.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:24.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:24.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:24.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.672 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.672 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:24.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114264806 for job 77d052e6e51b5ae35525074f80512696.
14:24:24.818 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:24:24.819 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:24:24.833 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:24.834 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:24.834 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:24.834 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.834 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.835 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.835 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.835 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.835 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.835 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.835 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.835 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:24.884 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:24.955 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:24.955 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:24.955 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:24.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:24.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:24.956 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.956 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.956 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:24.956 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:24.969 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:24.969 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:24.969 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:24.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.970 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:24.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:24.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:24.970 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:25.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:23.594460 16504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:25.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:24.995498 16502 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 16494
14:24:25.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.018479 16494 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.426s	user 0.494s	sys 0.916s
14:24:25.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.018923 16494 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.427s	user 0.494s	sys 0.916s
14:24:25.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.026290 16510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:25.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.026427 16494 server_base.cc:1061] running on GCE node
14:24:25.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.027611 16494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:25.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.029947 16494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:25.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.031371 16494 hybrid_clock.cc:648] HybridClock initialized: now 1779114265031329 us; error 35 us; skew 500 ppm
14:24:25.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.032213 16494 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:25.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.038266 16494 webserver.cc:533] Webserver started at http://127.15.248.189:40521/ using document root <none> and password file <none>
14:24:25.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.039011 16494 fs_manager.cc:362] Metadata directory not provided
14:24:25.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.039184 16494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:25.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.039534 16494 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:25.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.043757 16494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data/instance:
14:24:25.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a9009660e4424e08bb3a7ecf3c0daf30"
14:24:25.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:25 on dist-test-slave-1n46"
14:24:25.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.044766 16494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal/instance:
14:24:25.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a9009660e4424e08bb3a7ecf3c0daf30"
14:24:25.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:25 on dist-test-slave-1n46"
14:24:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.052048 16494 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.005s
14:24:25.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.057605 16516 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:25.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.058665 16494 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.058962 16494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a9009660e4424e08bb3a7ecf3c0daf30"
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:25 on dist-test-slave-1n46"
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.059234 16494 fs_report.cc:389] FS layout report
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data/data
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:25.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:25.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.108479 16494 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:25.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:25.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.110198 16494 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:25.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.110669 16494 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:25.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.185081 16494 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.189:37707
14:24:25.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.185170 16567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.189:37707 every 8 connection(s)
14:24:25.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.187580 16494 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/data/info.pb
14:24:25.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.193840 16568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:25.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.194412 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16494
14:24:25.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.194869 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-1/wal/instance
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.197799 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/logs
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data/info.pb
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.188:46025
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.188
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:25.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json with env {}
14:24:25.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.206830 16568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } has no permanent_uuid. Determining permanent_uuid...
14:24:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.233389 16568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
14:24:25.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.248276 16568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
14:24:25.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.250370 16518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.254489 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.256 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:25.256 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:25.256 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:25.256 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.256 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.257 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:25.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.303934 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 1
14:24:25.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114265306 for job 77d052e6e51b5ae35525074f80512696.
14:24:25.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.311151 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.314 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:25.315 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:24:25.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:25.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:25.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:25.342 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:25.342 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:25.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:25.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:25.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:25.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:25.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:25.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:25.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:25.342 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:25.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.379621 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 2
14:24:25.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:25.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.383782 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.475244 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 3
14:24:25.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.478952 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.512138 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } attempt: 7
14:24:25.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.523955 16492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
14:24:25.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.528626 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.532451 16570 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.533038 16570 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.533562 16570 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.565511 16570 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.565884 16570 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.566239 16570 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.566529 16570 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.566861 16570 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.567117 16570 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41231/jwks.json
14:24:25.571 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:25.572 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:25.572 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:25.572 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.572 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.572 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.572 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:25.572 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:25.572 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.572 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.572 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:25.572 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:25.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.586956 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 1
14:24:25.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.590560 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.618904 16570 master_runner.cc:387] Master server non-default flags:
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.188:46025
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41231/jwks.json
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data/info.pb
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.188
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/logs
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:25.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.620425 16570 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:25.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.622342 16570 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:25.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.622403 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 4
14:24:25.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.626627 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.635088 16582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:25.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.671984 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 2
14:24:25.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.679394 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.764906 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 3
14:24:25.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.772449 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114265806 for job 77d052e6e51b5ae35525074f80512696.
14:24:25.824 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:24:25.825 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:24:25.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:25.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.913020 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 4
14:24:25.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.920022 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:25.926110 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 5
14:24:25.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.932828 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:26.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:26.190 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:26.190 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:26.190 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:26.191 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.191 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.191 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.192 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.192 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.192 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.193 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:26.193 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:26.194 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:26.194 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:26.194 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.194 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.194 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.195 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.195 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.195 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.195 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:26.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:26.203754 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 5
14:24:26.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:26.217171 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:26.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114266307 for job 77d052e6e51b5ae35525074f80512696.
14:24:26.320 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:24:26.321 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:24:26.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:26.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:26.480397 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 6
14:24:26.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:26.508064 16568 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:26.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:26.659 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:26.659 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:26.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.660 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:26.660 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.661 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.661 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.661 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.661 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:26.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:26.769740 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 6
14:24:26.771 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:26.772 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:26.772 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:26.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.773 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.773 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.773 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.773 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.773 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.773 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:26.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:26.800958 16492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.248.188:46025: Network error: Client connection negotiation failed: client connection to 127.15.248.188:46025: connect: Connection refused (error 111)
14:24:26.806 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114266806 for job 77d052e6e51b5ae35525074f80512696.
14:24:26.817 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:26.818 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:24:26.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:26.892 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:26.892 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:26.893 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:26.893 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.893 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.893 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:26.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.894 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:26.894 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.894 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.895 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:26.895 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:26.954 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:26.955 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:26.955 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:26.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:26.956 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.956 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.956 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:26.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:26.957 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:27.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:26.987771 16570 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.352s	user 0.436s	sys 0.913s
14:24:27.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.010078 16570 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.375s	user 0.438s	sys 0.913s
14:24:27.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.011229 16585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:27.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.010388 16570 server_base.cc:1061] running on GCE node
14:24:27.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:25.647531 16583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.014185 16570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:27.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.022230 16570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:27.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.023612 16570 hybrid_clock.cc:648] HybridClock initialized: now 1779114267023559 us; error 47 us; skew 500 ppm
14:24:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.025897 16570 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:27.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.045568 16570 webserver.cc:533] Webserver started at http://127.15.248.188:46211/ using document root <none> and password file <none>
14:24:27.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.046557 16570 fs_manager.cc:362] Metadata directory not provided
14:24:27.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.046800 16570 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:27.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.047346 16570 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.052146 16570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data/instance:
14:24:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fbe061e0abc4233ac33a3c8e194973e"
14:24:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:27 on dist-test-slave-1n46"
14:24:27.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.053501 16570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal/instance:
14:24:27.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fbe061e0abc4233ac33a3c8e194973e"
14:24:27.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:27 on dist-test-slave-1n46"
14:24:27.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.062372 16570 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.002s
14:24:27.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.078929 16598 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:27.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.080498 16570 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.002s	sys 0.010s
14:24:27.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.080946 16570 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal
14:24:27.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fbe061e0abc4233ac33a3c8e194973e"
14:24:27.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:27 on dist-test-slave-1n46"
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.081367 16570 fs_report.cc:389] FS layout report
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data/data
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:27.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:27.095 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:27.095 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:27.095 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:27.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:27.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:27.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:27.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:27.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:27.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:27.097 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:27.097 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:27.097 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:27.097 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:27.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:27.137 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:27.138 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:27.138 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:27.138 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:27.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:27.138 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:27.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:27.138 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:27.138 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:27.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:27.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:27.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:27.139 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.154402 16570 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.156040 16570 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.156508 16570 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:27.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.234391 16570 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.188:46025
14:24:27.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.234473 16650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.188:46025 every 8 connection(s)
14:24:27.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.237710 16570 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/data/info.pb
14:24:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.243280 16651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:27.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.247675 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16570
14:24:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.248013 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/master-2/wal/instance
14:24:27.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.255098 16651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } has no permanent_uuid. Determining permanent_uuid...
14:24:27.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.277685 16651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
14:24:27.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.296589 16651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
14:24:27.308 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114267306 for job 77d052e6e51b5ae35525074f80512696.
14:24:27.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.313437 16651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: Bootstrap starting.
14:24:27.318 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:24:27.319 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:24:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.321111 16651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: Neither blocks nor log segments found. Creating new log.
14:24:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.322924 16651 log.cc:826] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: Log is configured to *not* fsync() on all Append() calls
14:24:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.327517 16651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: No bootstrap required, opened a new log
14:24:27.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.346071 16651 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.346701 16651 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:27.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.346961 16651 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fbe061e0abc4233ac33a3c8e194973e, State: Initialized, Role: FOLLOWER
14:24:27.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.347709 16651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.349740 16661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.350294 16661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: This master's current role is: FOLLOWER
14:24:27.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.350942 16651 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: configured and running, proceeding with master startup.
14:24:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.371997 16661 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:27.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.372473 16661 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.375191 16661 leader_election.cc:290] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cee9bfc4ba46c7996d1b7a669e6b65 (127.15.248.190:44713), a9009660e4424e08bb3a7ecf3c0daf30 (127.15.248.189:37707)
14:24:27.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.378238 16672 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:24:27.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.378569 16672 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:24:27.390 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:27.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.379444 16570 master_runner.cc:187] Error getting master registration for 127.15.248.190:44713: OK, instance_id { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" instance_seqno: 1779114263145330 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:24:27.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.407164 16570 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:24:27.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.411659 16605 tablet.cc:2404] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:27.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.568531 16568 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 7
14:24:27.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.606259 16568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: Bootstrap starting.
14:24:27.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:27.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.613620 16568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: Neither blocks nor log segments found. Creating new log.
14:24:27.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.615700 16568 log.cc:826] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: Log is configured to *not* fsync() on all Append() calls
14:24:27.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.621114 16568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: No bootstrap required, opened a new log
14:24:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.651448 16568 raft_consensus.cc:359] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.658195 16568 raft_consensus.cc:385] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.658651 16568 raft_consensus.cc:740] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9009660e4424e08bb3a7ecf3c0daf30, State: Initialized, Role: FOLLOWER
14:24:27.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.659711 16568 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.671130 16568 sys_catalog.cc:565] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: configured and running, proceeding with master startup.
14:24:27.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.671277 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6fbe061e0abc4233ac33a3c8e194973e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" is_pre_election: true
14:24:27.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.672133 16543 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fbe061e0abc4233ac33a3c8e194973e in term 0.
14:24:27.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.673915 16601 leader_election.cc:304] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fbe061e0abc4233ac33a3c8e194973e, a9009660e4424e08bb3a7ecf3c0daf30; no voters: 
14:24:27.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.668251 16676 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.674798 16676 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: This master's current role is: FOLLOWER
14:24:27.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.674971 16661 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:27.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.675369 16661 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:27.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.675730 16661 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 0 FOLLOWER]: Advancing to term 1
14:24:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.690383 16661 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.703209 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6fbe061e0abc4233ac33a3c8e194973e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9009660e4424e08bb3a7ecf3c0daf30"
14:24:27.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.703763 16543 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 0 FOLLOWER]: Advancing to term 1
14:24:27.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.705559 16661 leader_election.cc:290] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [CANDIDATE]: Term 1 election: Requested vote from peers 24cee9bfc4ba46c7996d1b7a669e6b65 (127.15.248.190:44713), a9009660e4424e08bb3a7ecf3c0daf30 (127.15.248.189:37707)
14:24:27.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.712882 16543 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fbe061e0abc4233ac33a3c8e194973e in term 1.
14:24:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.714105 16601 leader_election.cc:304] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fbe061e0abc4233ac33a3c8e194973e, a9009660e4424e08bb3a7ecf3c0daf30; no voters: 
14:24:27.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.714983 16661 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 1 FOLLOWER]: Leader election won for term 1
14:24:27.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.717079 16661 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [term 1 LEADER]: Becoming Leader. State: Replica: 6fbe061e0abc4233ac33a3c8e194973e, State: Running, Role: LEADER
14:24:27.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.718289 16661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.736056 16684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fbe061e0abc4233ac33a3c8e194973e. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.736961 16684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: This master's current role is: LEADER
14:24:27.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.740276 16686 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:24:27.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.747527 16686 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:24:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.772758 16543 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [term 1 FOLLOWER]: Refusing update from remote peer 6fbe061e0abc4233ac33a3c8e194973e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:24:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.774528 16684 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:27.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.784226 16690 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:24:27.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.784962 16690 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:24:27.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114267806 for job 77d052e6e51b5ae35525074f80512696.
14:24:27.817 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:24:27.819 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:24:27.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.834373 16492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } attempt: 7
14:24:27.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.758934 16494 master_runner.cc:187] Error getting master registration for 127.15.248.190:44713: OK, instance_id { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" instance_seqno: 1779114263145330 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:24:27.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.842170 16494 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:24:27.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.866364 16676 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fbe061e0abc4233ac33a3c8e194973e. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.867096 16676 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: This master's current role is: FOLLOWER
14:24:27.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:27.868558 16522 tablet.cc:2404] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:27.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.876124 16661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.876807 16661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: This master's current role is: LEADER
14:24:27.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.878898 16686 catalog_manager.cc:1383] Generated new cluster ID: d1d2316d997541f7a0cef09fb5050563
14:24:27.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.879138 16686 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:24:27.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:27.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.904917 16676 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:27.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.905543 16676 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30 [sys.catalog]: This master's current role is: FOLLOWER
14:24:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.914364 16492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: Bootstrap starting.
14:24:27.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.930825 16492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: Neither blocks nor log segments found. Creating new log.
14:24:27.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.933259 16492 log.cc:826] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: Log is configured to *not* fsync() on all Append() calls
14:24:27.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.954222 16686 catalog_manager.cc:1406] Generated new certificate authority record
14:24:27.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.956023 16686 catalog_manager.cc:1540] Loading token signing keys...
14:24:27.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.959997 16492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: No bootstrap required, opened a new log
14:24:27.961 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:27.961 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:27.961 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:27.961 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:27.961 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:27.961 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:27.961 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:27.962 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:27.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:27.962 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:27.962 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:27.962 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:27.962 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:27.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.988615 16686 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: Generated new TSK 0
14:24:27.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:27.989647 16686 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:24:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.027400 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/logs
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data/info.pb
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.129:0
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.129
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.129
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:28.035 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:28.036 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:28.036 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:28.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:28.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:28.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:28.036 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:28.037 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:28.037 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:28.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:28.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:28.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:28.037 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:28.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.063987 16492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:28.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.068835 16492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:28.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.070055 16492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cee9bfc4ba46c7996d1b7a669e6b65, State: Initialized, Role: FOLLOWER
14:24:28.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.071048 16492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } }
14:24:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.087659 16700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.088371 16700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: This master's current role is: FOLLOWER
14:24:28.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.089630 16492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: configured and running, proceeding with master startup.
14:24:28.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.092700 16465 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [term 0 FOLLOWER]: Advancing to term 1
14:24:28.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.095703 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6fbe061e0abc4233ac33a3c8e194973e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65"
14:24:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.089836 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6fbe061e0abc4233ac33a3c8e194973e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" is_pre_election: true
14:24:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.106065 16445 tablet.cc:2404] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:28.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:28.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.110260 16465 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [term 1 FOLLOWER]: Refusing update from remote peer 6fbe061e0abc4233ac33a3c8e194973e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:24:28.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.111863 16684 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:28.130 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:28.131 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:28.131 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:28.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.132 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.133 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:28.157 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:28.158 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:28.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:28.158 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:28.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:28.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:28.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:28.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:28.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:28.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:28.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:28.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:28.181 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:28.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.205220 16700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fbe061e0abc4233ac33a3c8e194973e. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:28.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.206033 16700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: This master's current role is: FOLLOWER
14:24:28.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.208459 16706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:28.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.209388 16706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65 [sys.catalog]: This master's current role is: FOLLOWER
14:24:28.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.295132 16716 catalog_manager.cc:1295] Loaded cluster ID: d1d2316d997541f7a0cef09fb5050563
14:24:28.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.296229 16716 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: loading cluster ID for follower catalog manager: success
14:24:28.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114268306 for job 77d052e6e51b5ae35525074f80512696.
14:24:28.320 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:24:28.321 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:24:28.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.329502 16716 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: acquiring CA information for follower catalog manager: success
14:24:28.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:28.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:28.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:28.332 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.332 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.332 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.333 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:28.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.350396 16716 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 24cee9bfc4ba46c7996d1b7a669e6b65: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:24:28.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:28.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.544559 16647 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 16575
14:24:28.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.664140 16699 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.664687 16699 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:28.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.665292 16699 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.690752 16684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6fbe061e0abc4233ac33a3c8e194973e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cee9bfc4ba46c7996d1b7a669e6b65" member_type: VOTER last_known_addr { host: "127.15.248.190" port: 44713 } } peers { permanent_uuid: "a9009660e4424e08bb3a7ecf3c0daf30" member_type: VOTER last_known_addr { host: "127.15.248.189" port: 37707 } } peers { permanent_uuid: "6fbe061e0abc4233ac33a3c8e194973e" member_type: VOTER last_known_addr { host: "127.15.248.188" port: 46025 } } }
14:24:28.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.692106 16684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e [sys.catalog]: This master's current role is: LEADER
14:24:28.713 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:28.713 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:28.714 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:28.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.714 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.714 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:28.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.718925 16699 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:28.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.719888 16699 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.248.129
14:24:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.791209 16690 catalog_manager.cc:1295] Loaded cluster ID: d1d2316d997541f7a0cef09fb5050563
14:24:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.791885 16690 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: loading cluster ID for follower catalog manager: success
14:24:28.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.803527 16690 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: acquiring CA information for follower catalog manager: success
14:24:28.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114268806 for job 77d052e6e51b5ae35525074f80512696.
14:24:28.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.816552 16690 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a9009660e4424e08bb3a7ecf3c0daf30: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:24:28.820 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:24:28.821 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.825387 16699 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.129:0
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data/info.pb
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.129
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.129
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/logs
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:28.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.827014 16699 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:28.829 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:28.830 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:28.830 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:28.830 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.830 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:28.830 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:28.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:28.831 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:28.836465 16699 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:28.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.878885 16726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:28.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:28.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:28.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:28.896 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:28.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:28.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:28.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:28.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:28.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:28.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:28.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:28.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:28.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:28.896 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:28.980 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:28.981 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:28.981 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:28.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:28.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:28.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:28.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:28.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:28.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:28.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:28.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:28.983 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:28.983 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:29.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:29.278 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:29.279 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:29.279 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:29.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.280 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:29.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114269306 for job 77d052e6e51b5ae35525074f80512696.
14:24:29.324 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:24:29.325 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:24:29.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:29.392 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:29.392 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:29.392 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:29.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:29.392 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:29.392 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:29.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:29.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:29.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:29.393 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:29.393 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:29.393 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:29.393 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:29.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:29.808 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114269806 for job 77d052e6e51b5ae35525074f80512696.
14:24:29.825 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
14:24:29.826 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:24:29.836 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:29.836 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:29.837 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:29.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:29.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:29.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:29.838 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:29.859 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:29.859 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:29.859 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:29.859 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:29.859 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:29.859 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:29.860 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:29.860 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:29.860 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:29.860 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:29.861 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:29.861 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:29.861 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:29.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:29.975 [DEBUG - pool-130-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [3ms] received response from server master-127.13.91.124:35565: OK, deferred=null) with no deferred attached!
14:24:30.109 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:30.161 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:30.161 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:30.162 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:30.166 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.166 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.166 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.167 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.167 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.167 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.167 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.167 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.167 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.167 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:30.198 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:30.198 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:30.198 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:30.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.199 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.200 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:30.240 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:30.241 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:30.241 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:30.242 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.242 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.242 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:30.242 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.242 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.242 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:30.242 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.243 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.243 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:30.243 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:30.272 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:30.272 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:30.273 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:30.273 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:30.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:30.273 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:30.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:30.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:30.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:30.274 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:30.274 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:30.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:30.274 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:30.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114270307 for job 77d052e6e51b5ae35525074f80512696.
14:24:30.318 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:24:30.319 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:24:30.335 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:30.335 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:30.335 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:30.335 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.335 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.336 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.336 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.336 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:30.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:30.414 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [18ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.414 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [21ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.414 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [19ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.415 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [18ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.415 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [19ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.415 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [19ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.415 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [23ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.415 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.14.33.60:39347, [22ms] received response from server master-127.14.33.60:39347: OK, deferred=null) with no deferred attached!
14:24:30.457 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:30.458 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:30.458 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:30.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:30.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:30.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:30.459 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:30.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:30.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:30.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:30.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:30.460 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:30.460 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:30.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:30.632 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:30.632 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:30.632 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:30.633 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.633 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.633 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:30.633 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.633 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:30.634 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.634 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.634 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:30.634 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:30.806 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114270806 for job 77d052e6e51b5ae35525074f80512696.
14:24:30.828 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
14:24:30.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:24:30.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:31.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:31.150 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:31.150 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:31.151 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:31.151 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.151 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.151 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.151 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.151 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.151 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.151 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.151 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.151 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:31.306 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114271306 for job 77d052e6e51b5ae35525074f80512696.
14:24:31.315 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:31.316 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:24:31.377 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:31.377 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:31.378 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:31.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.379 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:31.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:31.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:31.615 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:31.615 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:31.615 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:31.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:31.616 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:31.616 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:31.616 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:31.616 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:31.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:31.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:31.616 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:31.616 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:31.616 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:31.699 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:31.699 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:31.699 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:31.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.701 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.701 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:31.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114271806 for job 77d052e6e51b5ae35525074f80512696.
14:24:31.819 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:24:31.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:24:31.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:31.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:31.858 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:31.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.859 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.859 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.860 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.860 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.860 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.860 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:31.884 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:31.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:31.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:31.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:31.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:31.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:31.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:31.897 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:31.937 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:31.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:31.938 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:31.939 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:31.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:31.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:31.940 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:31.970 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:31.970 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:31.970 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:31.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.970 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.970 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:31.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:31.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:31.971 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:32.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:32.212 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:32.212 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:32.213 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:32.213 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.213 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.213 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.214 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:32.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114272306 for job 77d052e6e51b5ae35525074f80512696.
14:24:32.315 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:32.318 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:24:32.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:32.393 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:32.393 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:32.394 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:32.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.394 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.395 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.395 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:32.414 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:32.414 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:32.414 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:32.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:32.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.415 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:32.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.416 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:32.416 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:32.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:30.262238 16725 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 16699
14:24:32.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:32.502230 16725 kernel_stack_watchdog.cc:198] Thread 16699 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 378ms:
14:24:32.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:24:32.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:24:32.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:24:32.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:24:32.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:28.882453 16727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:32.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:32.507720 16699 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.627s	user 0.643s	sys 1.001s
14:24:32.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:32.508040 16699 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.627s	user 0.643s	sys 1.001s
14:24:32.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.519723 16699 server_base.cc:1061] running on GCE node
14:24:32.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:32.522473 16738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:32.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.523823 16699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:32.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.532414 16699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.540212 16699 hybrid_clock.cc:648] HybridClock initialized: now 1779114272540162 us; error 49 us; skew 500 ppm
14:24:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.541304 16699 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:32.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.579952 16699 webserver.cc:533] Webserver started at http://127.15.248.129:35835/ using document root <none> and password file <none>
14:24:32.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.581089 16699 fs_manager.cc:362] Metadata directory not provided
14:24:32.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.581344 16699 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:32.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.581921 16699 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.587757 16699 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data/instance:
14:24:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "504d6bc3351843caab10c4c62664c443"
14:24:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:32 on dist-test-slave-1n46"
14:24:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.588981 16699 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal/instance:
14:24:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "504d6bc3351843caab10c4c62664c443"
14:24:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:32 on dist-test-slave-1n46"
14:24:32.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.604455 16699 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.011s	sys 0.002s
14:24:32.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:32.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.622217 16743 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:32.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.627354 16699 fs_manager.cc:730] Time spent opening block manager: real 0.019s	user 0.000s	sys 0.012s
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.627759 16699 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "504d6bc3351843caab10c4c62664c443"
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:32 on dist-test-slave-1n46"
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.628275 16699 fs_report.cc:389] FS layout report
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal
14:24:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data/data
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:32.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:32.655 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:32.655 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:32.656 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:32.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:32.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:32.656 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:32.656 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:32.656 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:32.656 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:32.656 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:32.656 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:32.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:32.656 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:32.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.723132 16699 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:32.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.725445 16699 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:32.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.726014 16699 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:32.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.746506 16699 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.751698 16699 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.752012 16699 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.752305 16699 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.752569 16699 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:32.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114272806 for job 77d052e6e51b5ae35525074f80512696.
14:24:32.815 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:32.816 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:24:32.853 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:32.854 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:32.854 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:32.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.855 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.856 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:32.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:32.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:32.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:32.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:32.931 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.931 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.931 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:32.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:32.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:32.932 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:32.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.954173 16699 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.129:36421
14:24:32.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.954242 16855 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.129:36421 every 8 connection(s)
14:24:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.957512 16699 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/data/info.pb
14:24:32.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.960000 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16699
14:24:32.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.960556 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-0/wal/instance
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:32.991032 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/logs
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data/info.pb
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.130:0
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.130
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.130
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:33.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.008744 16856 heartbeater.cc:344] Connected to a master server at 127.15.248.188:46025
14:24:33.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.009274 16856 heartbeater.cc:461] Registering TS with master...
14:24:33.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.010721 16856 heartbeater.cc:507] Master 127.15.248.188:46025 requested a full tablet report, sending...
14:24:33.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.013934 16616 ts_manager.cc:194] Registered new tserver with Master: 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421)
14:24:33.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.018985 16616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.248.129:54785
14:24:33.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.032050 16857 heartbeater.cc:344] Connected to a master server at 127.15.248.189:37707
14:24:33.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.032485 16857 heartbeater.cc:461] Registering TS with master...
14:24:33.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.033317 16857 heartbeater.cc:507] Master 127.15.248.189:37707 requested a full tablet report, sending...
14:24:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.036417 16533 ts_manager.cc:194] Registered new tserver with Master: 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421)
14:24:33.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.058327 16860 heartbeater.cc:344] Connected to a master server at 127.15.248.190:44713
14:24:33.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.058647 16860 heartbeater.cc:461] Registering TS with master...
14:24:33.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.059243 16860 heartbeater.cc:507] Master 127.15.248.190:44713 requested a full tablet report, sending...
14:24:33.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.062925 16457 ts_manager.cc:194] Registered new tserver with Master: 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421)
14:24:33.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:33.199 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:33.199 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:33.199 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:33.200 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.200 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.200 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.200 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.200 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.200 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.200 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:33.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114273306 for job 77d052e6e51b5ae35525074f80512696.
14:24:33.313 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:24:33.314 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:24:33.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.353873 16863 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:33.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.354338 16863 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:33.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.354776 16863 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:33.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:33.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.386516 16863 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:33.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.387283 16863 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.248.130
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.425559 16863 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.130:0
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data/info.pb
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.130
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.130
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/logs
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:33.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:33.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.426812 16863 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:33.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:33.428565 16863 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:33.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.441145 16871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:33.456 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:33.456 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:33.456 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:33.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.457 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:33.537 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:33.538 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:33.538 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:33.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:33.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:33.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:33.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:33.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:33.538 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:33.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:33.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:33.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:33.539 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:33.592 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:33.592 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:33.592 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:33.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.593 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.593 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.593 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.594 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:33.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:33.807 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114273806 for job 77d052e6e51b5ae35525074f80512696.
14:24:33.816 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:24:33.817 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
14:24:33.822 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:33.822 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:33.822 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:33.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:33.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:33.823 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:33.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:33.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:33.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:33.824 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:33.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:33.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:33.824 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:33.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:33.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:33.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:33.895 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:33.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.895 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:33.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:33.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:33.896 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:33.955 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:33.955 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:33.955 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:33.956 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:33.956 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:33.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:33.956 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:33.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:33.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:33.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:33.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:33.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:33.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:34.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.023010 16856 heartbeater.cc:499] Master 127.15.248.188:46025 was elected leader, sending a full tablet report...
14:24:34.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:34.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:34.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:34.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:34.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:34.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:34.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:34.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:34.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:34.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:34.279 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:34.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:34.279 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:34.279 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:34.307 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114274306 for job 77d052e6e51b5ae35525074f80512696.
14:24:34.320 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 77d052e6e51b5ae35525074f80512696 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:24:34.321 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
14:24:34.333 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:34.333 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:34.333 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:34.334 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.334 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.334 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.334 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.335 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:34.385 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:34.455 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.455 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.455 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.457 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [1ms] received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [4ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [25ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [103ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [105ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [723ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [725ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [725ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1764ms] refreshing cache from master, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1766ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1766ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5143ms] refreshing cache from master, [5143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5146ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5146ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5246ms] refreshing cache from master, [5247ms] too many traces: truncated at 100 traces, deferred=Deferred@177359914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@5583f6b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893)))
14:24:34.457 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.458 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [1ms] received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [4ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [25ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [103ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [105ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [723ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [725ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [725ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1764ms] refreshing cache from master, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1766ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1766ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5143ms] refreshing cache from master, [5143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5146ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5146ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5246ms] refreshing cache from master, [5247ms] too many traces: truncated at 100 traces, deferred=Deferred@177359914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@5583f6b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [1ms] received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [4ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [25ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [103ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [105ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [723ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [725ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [725ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1764ms] refreshing cache from master, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1766ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1766ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5143ms] refreshing cache from master, [5143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5146ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5146ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5246ms] refreshing cache from master, [5247ms] too many traces: truncated at 100 traces, deferred=Deferred@177359914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@5583f6b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:34.459 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.459 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.459 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.459 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.459 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.460 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.460 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.460 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.460 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.466 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [1ms] received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [4ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [25ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [103ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [105ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [723ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [725ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [725ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1764ms] refreshing cache from master, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1766ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1766ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5143ms] refreshing cache from master, [5143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5146ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5146ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5246ms] refreshing cache from master, [5247ms] too many traces: truncated at 100 traces, deferred=Deferred@177359914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@5583f6b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] sending RPC to server master-127.13.91.124:35565, [1ms] received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [4ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [25ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [103ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [105ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [723ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [724ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [725ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [725ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1764ms] refreshing cache from master, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1765ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1766ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1766ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5143ms] refreshing cache from master, [5143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5145ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5146ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5146ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [5246ms] refreshing cache from master, [5247ms] too many traces: truncated at 100 traces, deferred=Deferred@177359914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@5583f6b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1089009234 after retry RPC after error@1653172769) -> (continuation of Deferred@2061666630 after retry RPC after error@815711950) -> (continuation of Deferred@935587049 after retry RPC after error@506609746) -> (continuation of Deferred@1886667371 after retry RPC after error@916083229) -> (continuation of Deferred@513168515 after retry RPC after error@313173971) -> (continuation of Deferred@1075824887 after retry RPC after error@619802707) -> (continuation of Deferred@149887490 after retry RPC after error@1337762035) -> (continuation of Deferred@1901756803 after retry RPC after error@1577452563) -> (continuation of Deferred@784935643 after retry RPC after error@81308873) -> (continuation of Deferred@564884296 after retry RPC after error@1331944946) -> (continuation of Deferred@681294135 after retry RPC after error@1768220169) -> (continuation of Deferred@330295646 after retry RPC after error@1114782356) -> (continuation of Deferred@936735212 after retry RPC after error@2043645361) -> (continuation of Deferred@365330127 after retry RPC after error@1177768057) -> (continuation of Deferred@1526006594 after retry RPC after error@1599254440) -> (continuation of Deferred@2042925707 after retry RPC after error@623420754) -> (continuation of Deferred@1463111078 after retry RPC after error@500205319) -> (continuation of Deferred@1079840508 after retry RPC after error@549400976) -> (continuation of Deferred@1561985116 after retry RPC after error@1156275271) -> (continuation of Deferred@1818857672 after retry RPC after error@889392996) -> (continuation of Deferred@949412216 after retry RPC after error@646024009) -> (continuation of Deferred@114208897 after retry RPC after error@723253011) -> (continuation of Deferred@604589609 after retry RPC after error@251150882) -> (continuation of Deferred@2101453252 after retry RPC after error@152461840) -> (continuation of Deferred@1736445213 after retry RPC after error@723892893)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:34.467 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:24:34.468 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:24:34.468 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
14:24:34.468 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:24:34.469 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:24:34.469 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:24:34.469 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:24:34.470 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
14:24:34.470 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:24:34.470 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:24:34.470 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:24:34.471 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:24:34.471 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
14:24:34.474 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.475 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.475 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.476 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.480 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state TERMINATED
14:24:34.480 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state TERMINATED
14:24:34.480 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state TERMINATED
14:24:34.480 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:34.481 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:24:34.481 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:24:34.482 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:24:34.482 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:24:34.482 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:24:34.484 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state TERMINATED
14:24:34.484 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state TERMINATED
14:24:34.484 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state TERMINATED
14:24:34.484 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:34.484 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:24:34.485 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:34.485 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:24:34.485 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:24:34.486 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:24:34.486 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:24:34.485 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:24:34.488 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:24:34.488 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:24:34.488 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:24:34.491 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:24:34.491 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:24:34.491 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:24:34.494 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.494 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.495 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state TERMINATED
14:24:34.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.495 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state TERMINATED
14:24:34.495 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state TERMINATED
14:24:34.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.495 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:34.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.496 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.496 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.496 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.496 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.496 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.496 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.497 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:24:34.497 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:34.497 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:24:34.497 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:24:34.497 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:24:34.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.14.33.60:39347(127.14.33.60:39347)] disconnecting while in state TERMINATED
14:24:34.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.14.33.61:38507(127.14.33.61:38507)] disconnecting while in state TERMINATED
14:24:34.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 63d18dedf3764a52adb9e90348858e1b(127.14.33.1:43269)] disconnecting while in state TERMINATED
14:24:34.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.14.33.62:33795(127.14.33.62:33795)] disconnecting while in state TERMINATED
14:24:34.500 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:34.500 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:34.500 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:34.500 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:34.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.501 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.502 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:34.502 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:24:34.503 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
14:24:34.501 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.505 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:34.506 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26774), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [17ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [20ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [52ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [54ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [125ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [134ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [135ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [136ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [163ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [285ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [285ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [662ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1504ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2822ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3304ms] too many traces: truncated at 100 traces, deferred=Deferred@336398727(state=PENDING, result=null, callback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993), errback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993)))
14:24:34.507 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:24:34.507 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26774), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [17ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [20ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [52ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [54ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [125ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [134ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [135ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [136ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [163ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [285ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [285ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [662ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1504ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2822ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3304ms] too many traces: truncated at 100 traces, deferred=Deferred@336398727(state=PENDING, result=null, callback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993), errback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:34.508 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
14:24:34.510 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
14:24:34.513 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26774), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [17ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [20ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [52ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [54ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [125ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [134ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [135ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [136ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [163ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [163ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [285ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [285ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [662ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1504ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2822ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3304ms] too many traces: truncated at 100 traces, deferred=Deferred@336398727(state=PENDING, result=null, callback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993), errback=(continuation of Deferred@1563372864 after retry RPC after error@757599500) -> (continuation of Deferred@997120800 after retry RPC after error@1196670203) -> (continuation of Deferred@1664273532 after retry RPC after error@236977531) -> (continuation of Deferred@1130725443 after retry RPC after error@428562608) -> (continuation of Deferred@1823418065 after retry RPC after error@489355802) -> (continuation of Deferred@1914832484 after retry RPC after error@825204296) -> (continuation of Deferred@614706962 after retry RPC after error@1846770614) -> (continuation of Deferred@207634742 after retry RPC after error@1106264876) -> (continuation of Deferred@2014490431 after retry RPC after error@220833088) -> (continuation of Deferred@55454754 after retry RPC after error@1080358468) -> (continuation of Deferred@769835552 after retry RPC after error@1830908281) -> (continuation of Deferred@536637379 after retry RPC after error@2018344110) -> (continuation of Deferred@1124422213 after retry RPC after error@633948645) -> (continuation of Deferred@1496824040 after retry RPC after error@1242306412) -> (continuation of Deferred@603120402 after retry RPC after error@1276842216) -> (continuation of Deferred@672072059 after retry RPC after error@34784353) -> (continuation of Deferred@919358786 after retry RPC after error@574920483) -> (continuation of Deferred@1913675465 after retry RPC after error@1714797862) -> (continuation of Deferred@843537151 after retry RPC after error@876359195) -> (continuation of Deferred@1152043075 after retry RPC after error@255689085) -> (continuation of Deferred@128295623 after retry RPC after error@1388054750) -> (continuation of Deferred@1086728730 after retry RPC after error@596868374) -> (continuation of Deferred@160059449 after retry RPC after error@994198318) -> (continuation of Deferred@1252341926 after retry RPC after error@1919325993)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:34.515 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
14:24:34.515 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:24:34.515 [WARN - flink-pekko.actor.default-dispatcher-9] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
14:24:34.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
14:24:34.515 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:34.516 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.516 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.516 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.517 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.517 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.517 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.518 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.518 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.518 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.518 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.522 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
14:24:34.522 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
14:24:34.523 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:24:34.524 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:24:34.524 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:34.525 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:34.530 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:24:34.530 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:24:34.530 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:24:34.530 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:24:34.531 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:24:34.531 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:24:34.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:34.532 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:34.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:34.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:34.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:34.533 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.533 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.533 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:34.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.533 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.533 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:34.533 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:34.534 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:24:34.534 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
14:24:34.535 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:24:34.535 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:24:34.535 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.535 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.536 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.536 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
14:24:34.536 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:24:34.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.536 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.536 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 77d052e6e51b5ae35525074f80512696
14:24:34.537 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.537 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.538 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.574 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.574 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.574 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.576 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.576 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.576 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.576 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.595 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.595 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.595 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.595 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.595 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.595 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.596 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.596 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.596 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.714 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.715 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.715 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.715 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.715 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.715 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.716 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.716 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:33.443166 16872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:34.815 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.815 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.816 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.816 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.816 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.816 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.817 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:34.817574 16874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:34.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:34.819523 16873 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1372 milliseconds
14:24:34.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.819643 16863 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:34.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.821096 16863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:34.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.823447 16863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:34.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.824810 16863 hybrid_clock.cc:648] HybridClock initialized: now 1779114274824761 us; error 45 us; skew 500 ppm
14:24:34.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.825631 16863 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:34.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.831867 16863 webserver.cc:533] Webserver started at http://127.15.248.130:39307/ using document root <none> and password file <none>
14:24:34.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.832839 16863 fs_manager.cc:362] Metadata directory not provided
14:24:34.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.833072 16863 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:34.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.833562 16863 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:34.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.838042 16863 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data/instance:
14:24:34.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:34.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:34 on dist-test-slave-1n46"
14:24:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.839116 16863 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal/instance:
14:24:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:34 on dist-test-slave-1n46"
14:24:34.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.845635 16863 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
14:24:34.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.850797 16905 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:34.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.851820 16863 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
14:24:34.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.852115 16863 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal
14:24:34.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:34.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:34 on dist-test-slave-1n46"
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.852460 16863 fs_report.cc:389] FS layout report
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data/data
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:34.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:34.894 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:34.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:34.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:34.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.895 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.895 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:34.895 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.895 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:34.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:34.896 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:34.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.910471 16863 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:34.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.911873 16863 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:34.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.912254 16863 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:34.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.914714 16863 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:34.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.919066 16863 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:34.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.919255 16863 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:34.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.919505 16863 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:34.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:34.919705 16863 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:34.995 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:34.995 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:34.995 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:34.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:34.996 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:34.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:34.996 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:35.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.065670 16863 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.130:41989
14:24:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.065780 17017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.130:41989 every 8 connection(s)
14:24:35.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.068221 16863 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/data/info.pb
14:24:35.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.071058 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 16863
14:24:35.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.071476 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-1/wal/instance
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.097690 16354 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/logs
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data/info.pb
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.131:0
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.131
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.131
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:24:35.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.147150 17020 heartbeater.cc:344] Connected to a master server at 127.15.248.190:44713
14:24:35.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.147572 17020 heartbeater.cc:461] Registering TS with master...
14:24:35.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.148630 17020 heartbeater.cc:507] Master 127.15.248.190:44713 requested a full tablet report, sending...
14:24:35.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.148849 17019 heartbeater.cc:344] Connected to a master server at 127.15.248.189:37707
14:24:35.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.149163 17019 heartbeater.cc:461] Registering TS with master...
14:24:35.150 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:35.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.150065 17019 heartbeater.cc:507] Master 127.15.248.189:37707 requested a full tablet report, sending...
14:24:35.150 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:35.150 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:35.150 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.150 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.150 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.151 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.151 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.151 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.151 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.151 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.151 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.152107 17018 heartbeater.cc:344] Connected to a master server at 127.15.248.188:46025
14:24:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.152436 17018 heartbeater.cc:461] Registering TS with master...
14:24:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.153235 17018 heartbeater.cc:507] Master 127.15.248.188:46025 requested a full tablet report, sending...
14:24:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.153348 16457 ts_manager.cc:194] Registered new tserver with Master: 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.153900 16533 ts_manager.cc:194] Registered new tserver with Master: 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:35.154 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.155 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.155 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.155 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.155 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.156 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.156 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.156265 16616 ts_manager.cc:194] Registered new tserver with Master: 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:35.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.157588 16616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.248.130:52507
14:24:35.373 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:35.373 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:35.374 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:35.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.374 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.374 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.374 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.374 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:35.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.435310 17026 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.435708 17026 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:35.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.436189 17026 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:35.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.467655 17026 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:35.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.468325 17026 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.248.131
14:24:35.478 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:24:35.479 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:24:35.480 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
14:24:35.480 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:24:35.481 [INFO - Thread-31] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:24:35.481 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
14:24:35.481 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state TERMINATED
14:24:35.481 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state TERMINATED
14:24:35.481 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state TERMINATED
14:24:35.481 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:35.482 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:35.482 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
14:24:35.483 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:24:35.483 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:24:35.483 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:24:35.484 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:24:35.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
14:24:35.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
14:24:35.485 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:35.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5d0669fd
14:24:35.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:35.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:35.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:24:35.486 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:24:35.486 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:24:35.486 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
14:24:35.487 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:24:35.487 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:24:35.487 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
14:24:35.488 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
14:24:35.488 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:24:35.488 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:35.488 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:24:35.488 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:24:35.489 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1aa3ca91
14:24:35.489 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:35.489 [INFO - Thread-31] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:24:35.489 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:35.489 [INFO - Thread-31] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:24:35.489 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:24:35.490 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
14:24:35.490 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:24:35.490 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
14:24:35.490 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:24:35.490 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:35.491 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
14:24:35.492 [DEBUG - Thread-31] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:35.492 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:24:35.492 [INFO - Thread-31] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:35.492 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:24:35.493 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:24:35.493 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:24:35.494 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a9e920b
14:24:35.494 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ec6a5f5
14:24:35.497 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:35.497 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:35.498 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:35.498 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:35.499 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:35.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:35.499 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:24:35.500 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:24:35.500 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
14:24:35.500 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
14:24:35.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43a953ef
14:24:35.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:35.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:35.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:24:35.501 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:24:35.503 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e9b733c
14:24:35.504 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:35.505 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.510 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.511 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
14:24:35.511 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
14:24:35.512 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b8148be
14:24:35.512 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:35.512 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:24:35.512 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:24:35.512 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:24:35.514 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23f063dd
14:24:35.515 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:35.516 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.517 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.518 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.518 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.518 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.519 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.519 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.519 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.520 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.520 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.520 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.521 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.522 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.523 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.524224 17026 tablet_server_runner.cc:78] Tablet server non-default flags:
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.248.148:35631
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.248.131:0
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data/info.pb
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.248.131
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.248.190:44713,127.15.248.189:37707,127.15.248.188:46025
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.248.131
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/logs
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:35.525 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:35.525 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:35.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:35.526 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.526 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.526615 17026 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:35.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.527 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.527 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.527 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.528 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.528 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.528 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.528 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.529 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.529 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:35.528875 17026 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:35.529 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.529 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.529 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.530 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.530 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.530 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.531 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.531 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.531 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.531 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.532 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.532 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.532 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.532 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.533 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.533 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.536 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.537 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.537 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.537 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.537 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.537 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.537 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.538 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.538 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.538 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.540 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.541 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.542 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.542 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.542 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.543102 17068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:35.545 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.549 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.549 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.550 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.550 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.551 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.554 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.554 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.554 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.554 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.556 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.561 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.569 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.570 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.570 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.573 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.575 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:35.575 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:35.575 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:35.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:35.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:35.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:35.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.576 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.576 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:35.578 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:35.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:35.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:35.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:35.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:35.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.578 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:35.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.579 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.579 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.580 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.580 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.580 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.580 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.581 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.581 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.581 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.581 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.583 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.583 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.583 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.583 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.584 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.585 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.586 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.586 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.586 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.586 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.587 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.587 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.587 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.587 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.587 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.587 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.588 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.588 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.589 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.590 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.590 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.591 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.595 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.596 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.596 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.596 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.597 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.597 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.597 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.600 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.601 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.601 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.601 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.602 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.602 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.605 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.605 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.606 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.606 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.606 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.606 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.606 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.611 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.611 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.611 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.611 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.612 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.612 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.616 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.616 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.616 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.617 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.618 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.619 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.620 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.620 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.621 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.621 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.621 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.621 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.622 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.622 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.622 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.623 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.625 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.625 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.625 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.626 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.631 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.631 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.632 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.632 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.632 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.632 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.632 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.632 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.632 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.633 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.633 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.633 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.633 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.641 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.641 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.641 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.642 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.642 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.642 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.642 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.642 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.642 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.642 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.642 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.643 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.643 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.643 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.643 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.643 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.643 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.644 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.651 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.651 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.651 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.651 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.652 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.657 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.657 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.657 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.658 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.658 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.658 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.662 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.662 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.662 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.662 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.663 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.663 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.663 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.663 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.666 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.666 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.666 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.666 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.666 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.667 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.669 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:35.669 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:35.670 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:35.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.670 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.670 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.671 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.671 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.671 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.671 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:35.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.672 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.672 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.672 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.672 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.672 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.672 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.676 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.677 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.677 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.677 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.677 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.677 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.677 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.677 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.677 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.682 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.682 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.683 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.683 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.684 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.685 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.686 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.686 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.686 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.686 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.687 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.696 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.696 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.697 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.698 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.698 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.698 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.698 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.698 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.701 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.701 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.701 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.701 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.701 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.701 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.702 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.705 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.705 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.705 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.706 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.706 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.706 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.706 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.706 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.706 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.706 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.722 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.722 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.722 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.723 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.723 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.723 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.724 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.724 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.724 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.730 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.731 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.731 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.731 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.731 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.731 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.732 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.732 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.732 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.732 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.736 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.736 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.736 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.737 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.737 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.738 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.776 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.776 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.776 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.777 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.777 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.777 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.779 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.779 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.779 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.785 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.786 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.786 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.786 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.786 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.786 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.790 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.790 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.790 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.801 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.801 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.801 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.801 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.802 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.802 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.802 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.802 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.802 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.803 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.803 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.804 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.804 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.804 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.804 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:35.864 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.865 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.865 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.866 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.866 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.866 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.867 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.867 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:35.868 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.868 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.868 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.870 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.870 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.872 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:35.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.872 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:35.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:35.873 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:35.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:35.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:35.874 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:35.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.876 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:35.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:35.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:35.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:35.892 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.892 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.892 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:35.892 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:35.893 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.893 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.893 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:35.893 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:35.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:35.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:35.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:35.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:35.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:35.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:35.984 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:36.020 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.021 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.021 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.021 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.022 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.022 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.023 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:36.160338 17018 heartbeater.cc:499] Master 127.15.248.188:46025 was elected leader, sending a full tablet report...
14:24:36.216 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:36.217 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:36.217 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:36.218 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.218 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.218 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.218 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.218 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.219 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:36.234 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:36.235 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:36.235 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:36.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.236 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.236 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.236 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.237 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:36.237 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [67ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [155ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [261ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [385ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [385ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [962ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [962ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1840ms] refreshing cache from master, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1843ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2861ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2862ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3421ms] refreshing cache from master, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3422ms] too many traces: truncated at 100 traces, deferred=Deferred@1003306650(state=PENDING, result=null, callback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432), errback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432)))
14:24:36.240 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:24:36.240 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [67ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [155ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [261ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [385ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [385ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [962ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [962ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1840ms] refreshing cache from master, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1843ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2861ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2862ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3421ms] refreshing cache from master, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3422ms] too many traces: truncated at 100 traces, deferred=Deferred@1003306650(state=PENDING, result=null, callback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432), errback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:36.241 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
14:24:36.243 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
14:24:36.246 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [64ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [67ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [155ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [261ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [385ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [385ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [962ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [962ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1840ms] refreshing cache from master, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1843ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2861ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2862ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3421ms] refreshing cache from master, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3422ms] too many traces: truncated at 100 traces, deferred=Deferred@1003306650(state=PENDING, result=null, callback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432), errback=(continuation of Deferred@672317751 after retry RPC after error@1180728653) -> (continuation of Deferred@2071015889 after retry RPC after error@698018251) -> (continuation of Deferred@398433974 after retry RPC after error@1383076633) -> (continuation of Deferred@545083199 after retry RPC after error@1591160394) -> (continuation of Deferred@905330952 after retry RPC after error@1733063796) -> (continuation of Deferred@763546389 after retry RPC after error@1254098321) -> (continuation of Deferred@1304032192 after retry RPC after error@1230164439) -> (continuation of Deferred@1915974027 after retry RPC after error@949296849) -> (continuation of Deferred@984665584 after retry RPC after error@1697873688) -> (continuation of Deferred@208004380 after retry RPC after error@479592919) -> (continuation of Deferred@552964344 after retry RPC after error@1589702721) -> (continuation of Deferred@2100212608 after retry RPC after error@1360694603) -> (continuation of Deferred@1566877120 after retry RPC after error@75437269) -> (continuation of Deferred@205854057 after retry RPC after error@162570623) -> (continuation of Deferred@1904365356 after retry RPC after error@229057653) -> (continuation of Deferred@703432437 after retry RPC after error@635068910) -> (continuation of Deferred@1178771798 after retry RPC after error@1920119143) -> (continuation of Deferred@938298354 after retry RPC after error@1095666160) -> (continuation of Deferred@316004510 after retry RPC after error@1976285738) -> (continuation of Deferred@673504698 after retry RPC after error@487641159) -> (continuation of Deferred@557705811 after retry RPC after error@151985844) -> (continuation of Deferred@130603810 after retry RPC after error@482451828) -> (continuation of Deferred@1382068173 after retry RPC after error@602661259) -> (continuation of Deferred@1656438559 after retry RPC after error@1944123453) -> (continuation of Deferred@615071563 after retry RPC after error@1479701996) -> (continuation of Deferred@1674242610 after retry RPC after error@387962726) -> (continuation of Deferred@2057433513 after retry RPC after error@829912580) -> (continuation of Deferred@98079074 after retry RPC after error@1813369432)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:36.248 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:36.249 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
14:24:36.250 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
14:24:36.257 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.257 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.258 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.259 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.260 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28533), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [10ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [13ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [13ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [32ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [38ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [56ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [87ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [125ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [143ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [143ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [243ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [243ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [282ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [761ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1943ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3303ms] too many traces: truncated at 100 traces, deferred=Deferred@11285789(state=PENDING, result=null, callback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482), errback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482)))
14:24:36.261 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.261 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.261 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.261 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28533), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [10ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [13ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [13ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [32ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [38ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [56ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [87ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [125ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [143ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [143ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [243ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [243ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [282ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [761ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1943ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3303ms] too many traces: truncated at 100 traces, deferred=Deferred@11285789(state=PENDING, result=null, callback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482), errback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28533), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [10ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [13ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [13ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [32ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [38ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [56ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [87ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [125ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [143ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [143ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [243ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [243ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [282ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [761ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1943ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3303ms] too many traces: truncated at 100 traces, deferred=Deferred@11285789(state=PENDING, result=null, callback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482), errback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:36.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.264 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.266 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28533), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [10ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [13ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [13ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [32ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [38ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [56ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [87ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [125ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [143ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [143ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [243ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [243ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [282ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [761ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1943ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3303ms] too many traces: truncated at 100 traces, deferred=Deferred@11285789(state=PENDING, result=null, callback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482), errback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28533), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [10ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [13ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [13ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [32ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [38ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [56ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [56ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [83ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [87ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [125ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [143ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [143ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [243ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [243ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [282ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [761ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [761ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1943ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3303ms] too many traces: truncated at 100 traces, deferred=Deferred@11285789(state=PENDING, result=null, callback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482), errback=(continuation of Deferred@814723226 after retry RPC after error@1244559241) -> (continuation of Deferred@1320520494 after retry RPC after error@802179896) -> (continuation of Deferred@1654011192 after retry RPC after error@1539146972) -> (continuation of Deferred@959682686 after retry RPC after error@345480683) -> (continuation of Deferred@1207653812 after retry RPC after error@1893180147) -> (continuation of Deferred@1434592511 after retry RPC after error@2102563681) -> (continuation of Deferred@1620651914 after retry RPC after error@756341072) -> (continuation of Deferred@1777706449 after retry RPC after error@5634581) -> (continuation of Deferred@689529066 after retry RPC after error@575468224) -> (continuation of Deferred@1716715637 after retry RPC after error@1232718840) -> (continuation of Deferred@721808397 after retry RPC after error@1855635807) -> (continuation of Deferred@280245329 after retry RPC after error@387259316) -> (continuation of Deferred@326428895 after retry RPC after error@727471063) -> (continuation of Deferred@452721745 after retry RPC after error@621583361) -> (continuation of Deferred@285911663 after retry RPC after error@1476497778) -> (continuation of Deferred@492697431 after retry RPC after error@1550879849) -> (continuation of Deferred@418192474 after retry RPC after error@1278448692) -> (continuation of Deferred@1042691498 after retry RPC after error@1718482371) -> (continuation of Deferred@370289304 after retry RPC after error@1179688538) -> (continuation of Deferred@1230272607 after retry RPC after error@1075728219) -> (continuation of Deferred@1197468458 after retry RPC after error@88018901) -> (continuation of Deferred@1875052973 after retry RPC after error@1561716633) -> (continuation of Deferred@1705726378 after retry RPC after error@412593005) -> (continuation of Deferred@1877890995 after retry RPC after error@490036472) -> (continuation of Deferred@581724405 after retry RPC after error@121987854) -> (continuation of Deferred@436993946 after retry RPC after error@770618047) -> (continuation of Deferred@1816435767 after retry RPC after error@1077272482)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:36.267 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:24:36.267 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
14:24:36.269 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
14:24:36.269 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:24:36.269 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
14:24:36.269 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:24:36.269 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
14:24:36.270 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:24:36.271 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:24:36.271 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
14:24:36.271 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:24:36.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.278 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.279 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.279 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.283 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:24:36.283 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:24:36.284 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:24:36.286 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:24:36.286 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
14:24:36.286 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:24:36.286 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:24:36.286 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
14:24:36.287 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
14:24:36.287 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:36.288 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:24:36.288 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:24:36.298 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.298 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.298 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.298 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.298 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.298 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.298 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.298 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.299 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.299 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.299 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.299 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:36.317 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.318 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.318 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.319 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.319 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.319 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.319 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.319 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.319 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.319 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.320 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.337 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.338 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.338 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.339 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.339 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.339 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.360 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.360 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.361 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.361 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.361 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.361 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.362 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.378 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.378 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.378 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.380 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.380 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.380 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.380 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:36.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.392 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.392 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.392 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.392 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.393 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.393 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.393 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.393 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.393 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.393 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.393 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.396 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.397 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.397 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.398 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.398 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.398 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.398 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.437 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.437 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.438 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.438 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.438 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.438 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.438 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.438 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.438 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.439 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.440 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.440 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.441 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.443 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.443 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.491 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:36.492 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:36.492 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:36.492 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.492 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.492 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.493 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.493 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.493 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.494 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:36.494 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28775), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [11ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [21ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [48ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [54ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [71ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [71ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [112ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [144ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [170ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [170ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [262ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [761ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [781ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [3160ms] refreshing cache from master, [3160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3161ms] too many traces: truncated at 100 traces, deferred=Deferred@964574344(state=PENDING, result=null, callback=(continuation of Deferred@2048201558 after retry RPC after error@1631408371) -> (continuation of Deferred@1196327412 after retry RPC after error@261910505) -> (continuation of Deferred@1564558063 after retry RPC after error@1458584444) -> (continuation of Deferred@1703039351 after retry RPC after error@160274697) -> (continuation of Deferred@1586291949 after retry RPC after error@158338971) -> (continuation of Deferred@2114907691 after retry RPC after error@464418098) -> (continuation of Deferred@582762790 after retry RPC after error@725196349) -> (continuation of Deferred@575619783 after retry RPC after error@1252045913) -> (continuation of Deferred@181762394 after retry RPC after error@1836766795) -> (continuation of Deferred@905701465 after retry RPC after error@2058784963) -> (continuation of Deferred@1535650150 after retry RPC after error@1618699474) -> (continuation of Deferred@170455460 after retry RPC after error@1154898090) -> (continuation of Deferred@1578076751 after retry RPC after error@1709779112) -> (continuation of Deferred@679559264 after retry RPC after error@1583636178) -> (continuation of Deferred@2082204323 after retry RPC after error@1343959520) -> (continuation of Deferred@1924921795 after retry RPC after error@248884104) -> (continuation of Deferred@767034883 after retry RPC after error@614839909) -> (continuation of Deferred@159196883 after retry RPC after error@718755231) -> (continuation of Deferred@1194514136 after retry RPC after error@1311590085) -> (continuation of Deferred@772188781 after retry RPC after error@1047357855) -> (continuation of Deferred@1874390172 after retry RPC after error@1258783936) -> (continuation of Deferred@1355356687 after retry RPC after error@87928856) -> (continuation of Deferred@768172079 after retry RPC after error@1520419026) -> (continuation of Deferred@1109307628 after retry RPC after error@709584327), errback=(continuation of Deferred@2048201558 after retry RPC after error@1631408371) -> (continuation of Deferred@1196327412 after retry RPC after error@261910505) -> (continuation of Deferred@1564558063 after retry RPC after error@1458584444) -> (continuation of Deferred@1703039351 after retry RPC after error@160274697) -> (continuation of Deferred@1586291949 after retry RPC after error@158338971) -> (continuation of Deferred@2114907691 after retry RPC after error@464418098) -> (continuation of Deferred@582762790 after retry RPC after error@725196349) -> (continuation of Deferred@575619783 after retry RPC after error@1252045913) -> (continuation of Deferred@181762394 after retry RPC after error@1836766795) -> (continuation of Deferred@905701465 after retry RPC after error@2058784963) -> (continuation of Deferred@1535650150 after retry RPC after error@1618699474) -> (continuation of Deferred@170455460 after retry RPC after error@1154898090) -> (continuation of Deferred@1578076751 after retry RPC after error@1709779112) -> (continuation of Deferred@679559264 after retry RPC after error@1583636178) -> (continuation of Deferred@2082204323 after retry RPC after error@1343959520) -> (continuation of Deferred@1924921795 after retry RPC after error@248884104) -> (continuation of Deferred@767034883 after retry RPC after error@614839909) -> (continuation of Deferred@159196883 after retry RPC after error@718755231) -> (continuation of Deferred@1194514136 after retry RPC after error@1311590085) -> (continuation of Deferred@772188781 after retry RPC after error@1047357855) -> (continuation of Deferred@1874390172 after retry RPC after error@1258783936) -> (continuation of Deferred@1355356687 after retry RPC after error@87928856) -> (continuation of Deferred@768172079 after retry RPC after error@1520419026) -> (continuation of Deferred@1109307628 after retry RPC after error@709584327)))
14:24:36.537 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.538 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.538 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.538 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.539 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.539 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.539 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.539 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.539 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.618 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.618 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.618 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.618 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.619 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.691 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.691 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.691 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.691 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.691 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.692 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.692 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.692 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.692 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.692 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.692 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.692 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.693 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.715 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:36.715 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:36.716 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.716 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:36.716 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.716 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:36.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.716 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.716 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:36.716 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:36.717 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:36.718 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28992), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [11ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [18ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [25ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [59ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [149ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [195ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [195ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [196ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [203ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [242ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [261ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [262ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [384ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [384ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [385ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [621ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [622ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1083ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1823ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1824ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2304ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2305ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2306ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2306ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3580ms] refreshing cache from master, [3581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3582ms] too many traces: truncated at 100 traces, deferred=Deferred@622390066(state=PENDING, result=null, callback=(continuation of Deferred@1670389579 after retry RPC after error@1716559474) -> (continuation of Deferred@1732118747 after retry RPC after error@85798517) -> (continuation of Deferred@1712591834 after retry RPC after error@81109604) -> (continuation of Deferred@330963701 after retry RPC after error@2142822513) -> (continuation of Deferred@963950239 after retry RPC after error@278652247) -> (continuation of Deferred@1404381187 after retry RPC after error@1798758764) -> (continuation of Deferred@2011853531 after retry RPC after error@940867628) -> (continuation of Deferred@1117475357 after retry RPC after error@519763619) -> (continuation of Deferred@975319821 after retry RPC after error@640401797) -> (continuation of Deferred@1043887335 after retry RPC after error@2000605805) -> (continuation of Deferred@1554988508 after retry RPC after error@619771941) -> (continuation of Deferred@1502752528 after retry RPC after error@1488856053) -> (continuation of Deferred@2111485155 after retry RPC after error@1581800109) -> (continuation of Deferred@384435419 after retry RPC after error@1071791224) -> (continuation of Deferred@389540555 after retry RPC after error@188110770) -> (continuation of Deferred@1295795923 after retry RPC after error@1662231280) -> (continuation of Deferred@1264217579 after retry RPC after error@1919432949) -> (continuation of Deferred@1565385397 after retry RPC after error@590860238) -> (continuation of Deferred@991611766 after retry RPC after error@143061872) -> (continuation of Deferred@988602527 after retry RPC after error@657985971) -> (continuation of Deferred@1251229529 after retry RPC after error@1974884360) -> (continuation of Deferred@671327801 after retry RPC after error@1339137795), errback=(continuation of Deferred@1670389579 after retry RPC after error@1716559474) -> (continuation of Deferred@1732118747 after retry RPC after error@85798517) -> (continuation of Deferred@1712591834 after retry RPC after error@81109604) -> (continuation of Deferred@330963701 after retry RPC after error@2142822513) -> (continuation of Deferred@963950239 after retry RPC after error@278652247) -> (continuation of Deferred@1404381187 after retry RPC after error@1798758764) -> (continuation of Deferred@2011853531 after retry RPC after error@940867628) -> (continuation of Deferred@1117475357 after retry RPC after error@519763619) -> (continuation of Deferred@975319821 after retry RPC after error@640401797) -> (continuation of Deferred@1043887335 after retry RPC after error@2000605805) -> (continuation of Deferred@1554988508 after retry RPC after error@619771941) -> (continuation of Deferred@1502752528 after retry RPC after error@1488856053) -> (continuation of Deferred@2111485155 after retry RPC after error@1581800109) -> (continuation of Deferred@384435419 after retry RPC after error@1071791224) -> (continuation of Deferred@389540555 after retry RPC after error@188110770) -> (continuation of Deferred@1295795923 after retry RPC after error@1662231280) -> (continuation of Deferred@1264217579 after retry RPC after error@1919432949) -> (continuation of Deferred@1565385397 after retry RPC after error@590860238) -> (continuation of Deferred@991611766 after retry RPC after error@143061872) -> (continuation of Deferred@988602527 after retry RPC after error@657985971) -> (continuation of Deferred@1251229529 after retry RPC after error@1974884360) -> (continuation of Deferred@671327801 after retry RPC after error@1339137795)))
14:24:36.736 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.737 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.737 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.737 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.737 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.738 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.739 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.786 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:36.786 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:36.786 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:36.787 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.787 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.787 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:36.787 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:36.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:36.788 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:36.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:36.837 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.837 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.838 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.838 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.838 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.838 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.839 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.839 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.839 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.839 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.840 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.885 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:36.897 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:36.898 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:36.898 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:36.898 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.898 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.899 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:36.899 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.899 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:36.899 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.899 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:36.899 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:36.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:36.983 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:36.983 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:36.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:36.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:36.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:36.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:36.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:36.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:36.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:36.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:36.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:36.985 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:37.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:36.946933 17067 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 17026
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:35.544286 17069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.360396 17067 kernel_stack_watchdog.cc:198] Thread 17026 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:24:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:24:37.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:24:37.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.360913 17026 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.817s	user 0.542s	sys 1.078s
14:24:37.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.361157 17026 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.817s	user 0.542s	sys 1.078s
14:24:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.362218 17073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:37.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.364856 17072 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1815 milliseconds
14:24:37.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.364915 17026 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:37.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.366093 17026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:37.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.368276 17026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:37.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.369616 17026 hybrid_clock.cc:648] HybridClock initialized: now 1779114277369586 us; error 22 us; skew 500 ppm
14:24:37.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.370445 17026 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:37.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.377488 17026 webserver.cc:533] Webserver started at http://127.15.248.131:41879/ using document root <none> and password file <none>
14:24:37.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.378516 17026 fs_manager.cc:362] Metadata directory not provided
14:24:37.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.378685 17026 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:37.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.379117 17026 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:37.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:37.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.383657 17026 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data/instance:
14:24:37.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:37.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:37 on dist-test-slave-1n46"
14:24:37.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.384769 17026 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal/instance:
14:24:37.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:37.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:37 on dist-test-slave-1n46"
14:24:37.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.391810 17026 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
14:24:37.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.397573 17106 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:37.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.398576 17026 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.398809 17026 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:37 on dist-test-slave-1n46"
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.399065 17026 fs_report.cc:389] FS layout report
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data/data
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:37.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:37.422 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:37.422 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:37.422 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:37.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:37.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:37.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:37.423 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:37.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:37.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:37.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:37.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:37.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:37.423 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:37.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.447310 17026 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:37.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.448649 17026 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:37.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.449020 17026 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:37.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.451424 17026 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:24:37.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.455531 17026 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:24:37.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.455693 17026 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:24:37.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.455865 17026 ts_tablet_manager.cc:616] Registered 0 tablets
14:24:37.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.455981 17026 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:24:37.596 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:37.597 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:37.597 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:37.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.598 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.598 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:37.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.618140 17026 rpc_server.cc:307] RPC server started. Bound to: 127.15.248.131:42259
14:24:37.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.618305 17218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.248.131:42259 every 8 connection(s)
14:24:37.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.620894 17026 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/data/info.pb
14:24:37.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.627187 16354 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 17026
14:24:37.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.627741 16354 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6090753083921552218/ts-2/wal/instance
14:24:37.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.695585 17219 heartbeater.cc:344] Connected to a master server at 127.15.248.188:46025
14:24:37.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.696108 17219 heartbeater.cc:461] Registering TS with master...
14:24:37.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.697268 17219 heartbeater.cc:507] Master 127.15.248.188:46025 requested a full tablet report, sending...
14:24:37.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.699774 16616 ts_manager.cc:194] Registered new tserver with Master: 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:37.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.701454 16616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.248.131:55479
14:24:37.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.702052 17220 heartbeater.cc:344] Connected to a master server at 127.15.248.189:37707
14:24:37.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.702358 17220 heartbeater.cc:461] Registering TS with master...
14:24:37.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.703164 17220 heartbeater.cc:507] Master 127.15.248.189:37707 requested a full tablet report, sending...
14:24:37.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.704447 17221 heartbeater.cc:344] Connected to a master server at 127.15.248.190:44713
14:24:37.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.704758 17221 heartbeater.cc:461] Registering TS with master...
14:24:37.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.705348 17221 heartbeater.cc:507] Master 127.15.248.190:44713 requested a full tablet report, sending...
14:24:37.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.705839 16532 ts_manager.cc:194] Registered new tserver with Master: 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:37.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.707649 16457 ts_manager.cc:194] Registered new tserver with Master: 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:37.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.723611 16354 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:24:37.734 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:24:37.734 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:24:37.735 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.248.190"
      port: 44713
    }
    bound_http_address {
      host: "127.15.248.190"
      port: 45371
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.248.189"
      port: 37707
    }
    bound_http_address {
      host: "127.15.248.189"
      port: 40521
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.248.188"
      port: 46025
    }
    bound_http_address {
      host: "127.15.248.188"
      port: 46211
    }
  }
}

14:24:37.736 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:24:37.736 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.248.129"
      port: 36421
    }
    bound_http_address {
      host: "127.15.248.129"
      port: 35835
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.248.130"
      port: 41989
    }
    bound_http_address {
      host: "127.15.248.130"
      port: 39307
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.248.131"
      port: 42259
    }
    bound_http_address {
      host: "127.15.248.131"
      port: 41879
    }
  }
}

14:24:37.736 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:24:37.738 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.739 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:37.740 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:37.740 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.52.61:40475(127.15.52.61:40475)] Successfully connected to peer
14:24:37.743 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.61
14:24:37.746 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:37.746 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.52.60:41453(127.15.52.60:41453)] Successfully connected to peer
14:24:37.748 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.52.62:42455(127.15.52.62:42455)] Successfully connected to peer
14:24:37.750 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.60
14:24:37.752 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:37.756 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe0474746, L:/127.0.0.1:47530 - R:/127.15.52.61:40475] using SASL/PLAIN
14:24:37.760 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.62
14:24:37.766 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:37.768 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x01e84d1c, L:/127.0.0.1:35050 - R:/127.15.52.62:42455] using SASL/PLAIN
14:24:37.772 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:37.775 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xabdf149d, L:/127.0.0.1:39512 - R:/127.15.52.60:41453] using SASL/PLAIN
14:24:37.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:37.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=40), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [19ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: OK, [40ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: OK, deferred=null) after lookup
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.781231 15822 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39512:
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:24:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\0012\000\000\000\004\001\226\000\000\000"
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:37.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:37.786806 15822 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:24:37.793 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:24:37.794 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:24:37.794 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:24:37.795 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:24:37.798 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
14:24:37.799 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:37.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
14:24:37.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:24:37.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
14:24:37.799 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:24:37.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
14:24:37.801 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:37.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
14:24:37.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:24:37.801 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:24:37.802 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:24:37.804 [INFO - Thread-32] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:24:37.804 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:24:37.804 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:24:37.804 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:24:37.805 [DEBUG - Thread-32] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:37.806 [INFO - Thread-32] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:24:37.807 [INFO - Thread-32] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:24:37.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:37.809 [DEBUG - Thread-32] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.809 [INFO - Thread-32] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:37.809 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:24:37.810 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:24:37.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
14:24:37.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
14:24:37.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@41b8784e
14:24:37.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:37.813 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:37.813 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:24:37.813 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:24:37.816 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:24:37.817 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
14:24:37.817 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
14:24:37.817 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@750b9004
14:24:37.817 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:37.818 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:24:37.820 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@478ebff8
14:24:37.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:37.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:24:37.820 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:24:37.822 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.825 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5867290e
14:24:37.827 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.828 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:37.828 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:37.828 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:37.828 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:37.828 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:24:37.829 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:24:37.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
14:24:37.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
14:24:37.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5883de96
14:24:37.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:37.831 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:37.831 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:24:37.831 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:24:37.833 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1afce80b
14:24:37.835 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
14:24:37.835 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
14:24:37.835 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ee0ecc8
14:24:37.835 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:37.836 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:24:37.837 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:24:37.837 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:24:37.837 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.840 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c14c9d
14:24:37.842 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:37.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:37.844 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.844 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.845 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.846 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.847 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.848 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.848 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.850 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.850 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.851 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.852 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.854 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.854 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.854 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.855 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.855 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.855 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.855 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.857 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.858 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.858 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.859 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.860 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.860 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.861 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.861 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.862 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.862 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.862 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.862 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.862 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.862 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.862 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.863 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.865 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.865 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.868 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:37.868 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.870 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.871 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.874 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.875 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.878 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.879 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.879 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.879 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.879 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.879 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.880 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.880 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.880 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.881 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.882 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.882 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.882 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.882 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.882 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.882 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.882 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.882 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.883 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:37.883 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.883 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.883 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.884 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.884 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.885 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.886 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.886 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.886 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.887 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.888 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.888 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.888 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.888 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.888 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.891 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.892 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.892 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.893 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.895 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.896 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.897 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.897 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.901 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.901 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.901 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.901 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:37.901 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:37.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:37.902 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:37.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:37.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:37.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.902 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:37.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:37.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:37.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:37.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:37.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:37.903 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:37.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.903 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.904 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.905 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.905 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.905 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.906 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.906 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.906 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.906 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.911 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.911 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.911 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.912 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.913 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.915 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.915 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.915 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.920 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.920 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.921 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.921 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.921 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.921 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.921 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.921 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.921 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.921 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.921 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.922 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.922 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.924 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.924 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.925 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.926 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.930 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.930 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.932 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.935 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.935 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.935 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.935 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.936 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.936 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.940 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.940 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.940 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.941 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.941 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.941 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.941 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.941 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:37.941 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.941 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.941 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.941 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:37.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:37.942 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:37.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.942 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.942 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.942 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.942 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:37.942 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:37.942 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:37.944 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.944 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.944 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.944 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.945 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.945 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.945 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.945 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.945 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.945 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.945 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.945 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.945 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.945 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.945 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.945 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.945 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.946 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.946 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.946 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.950 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.951 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.951 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.951 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.951 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.951 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.962 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.962 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.962 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.962 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.962 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.962 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.962 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.962 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.962 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.962 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.964 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.964 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.964 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.966 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.966 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.966 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.966 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.969652 16277 tablet_service.cc:1511] Processing CreateTablet for tablet aa2197643da04c3c8583bdf6a4bd6b34 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:37.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.968487 16276 tablet_service.cc:1511] Processing CreateTablet for tablet f3d59ba9291f4075b09130cbc06ca717 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:37.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:37.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:37.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:37.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.972 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.972 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:37.972 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.972 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.972 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:37.972 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.970988 16279 tablet_service.cc:1511] Processing CreateTablet for tablet 700268f26d6f48639ecc59e8eadbfc1a (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:37.972 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:37.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.969334 16278 tablet_service.cc:1511] Processing CreateTablet for tablet 17bc96540e05493cbecf58e57ab846f3 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:37.972 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:37.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.968720 16275 tablet_service.cc:1511] Processing CreateTablet for tablet b0d33a35fb26473baaf15bd936d6b042 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:37.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.971341 16277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2197643da04c3c8583bdf6a4bd6b34. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.972999 16276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d59ba9291f4075b09130cbc06ca717. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.973599 16278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bc96540e05493cbecf58e57ab846f3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.976 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.976 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.976 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.977 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.977 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.968482 16274 tablet_service.cc:1511] Processing CreateTablet for tablet 737c32be70c64db39b160c05047fc60d (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:37.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.974846 16274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737c32be70c64db39b160c05047fc60d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.975436 16275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d33a35fb26473baaf15bd936d6b042. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.977079 16279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700268f26d6f48639ecc59e8eadbfc1a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.981 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.981 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.981 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.982 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.982 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.982 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.982 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.982 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.982 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.984 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.984 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.984 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:37.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.985 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:37.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.989564 16135 tablet_service.cc:1511] Processing CreateTablet for tablet b0d33a35fb26473baaf15bd936d6b042 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:37.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.990355 16137 tablet_service.cc:1511] Processing CreateTablet for tablet aa2197643da04c3c8583bdf6a4bd6b34 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:37.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.994560 16135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d33a35fb26473baaf15bd936d6b042. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.990734 16134 tablet_service.cc:1511] Processing CreateTablet for tablet 737c32be70c64db39b160c05047fc60d (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:37.994 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:37.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:37.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:37.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.995378 16134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737c32be70c64db39b160c05047fc60d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.995 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.995 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.995 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:37.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.994396 15997 tablet_service.cc:1511] Processing CreateTablet for tablet 700268f26d6f48639ecc59e8eadbfc1a (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:37.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:37.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.990832 16138 tablet_service.cc:1511] Processing CreateTablet for tablet 17bc96540e05493cbecf58e57ab846f3 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:37.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.998306 16138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bc96540e05493cbecf58e57ab846f3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:37.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.998682 15995 tablet_service.cc:1511] Processing CreateTablet for tablet aa2197643da04c3c8583bdf6a4bd6b34 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:38.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.000123 16137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2197643da04c3c8583bdf6a4bd6b34. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:37.991070 16139 tablet_service.cc:1511] Processing CreateTablet for tablet 700268f26d6f48639ecc59e8eadbfc1a (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:38.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.001825 15994 tablet_service.cc:1511] Processing CreateTablet for tablet f3d59ba9291f4075b09130cbc06ca717 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:38.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.002264 16139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700268f26d6f48639ecc59e8eadbfc1a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.004050 15993 tablet_service.cc:1511] Processing CreateTablet for tablet b0d33a35fb26473baaf15bd936d6b042 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:38.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.006384 15992 tablet_service.cc:1511] Processing CreateTablet for tablet 737c32be70c64db39b160c05047fc60d (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:38.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.008 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.008 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.008 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.008 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.008 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.008 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.010 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.010 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.010 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.010485 15995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2197643da04c3c8583bdf6a4bd6b34. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.011 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:38.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:38.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:38.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.012 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:38.011 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.014 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.014 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.023247 15992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737c32be70c64db39b160c05047fc60d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.024801 15994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d59ba9291f4075b09130cbc06ca717. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.026211 15993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d33a35fb26473baaf15bd936d6b042. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.028029 17305 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.028190 16136 tablet_service.cc:1511] Processing CreateTablet for tablet f3d59ba9291f4075b09130cbc06ca717 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:38.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.029783 15996 tablet_service.cc:1511] Processing CreateTablet for tablet 17bc96540e05493cbecf58e57ab846f3 (DEFAULT_TABLE table=replication_test_table [id=02f5f67d99ce47d49e73c1f762ed4239]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.031013 15996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17bc96540e05493cbecf58e57ab846f3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.032200 16136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d59ba9291f4075b09130cbc06ca717. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.034590 15997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700268f26d6f48639ecc59e8eadbfc1a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:38.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.038471 17305 tablet_bootstrap.cc:654] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.040 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.040740 17305 log.cc:826] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Log is configured to *not* fsync() on all Append() calls
14:24:38.041 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.041 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.042 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.045 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.045 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.045 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.045 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.045 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.046 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.046 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.046 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.046 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.047 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.047 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.047 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.047 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.047 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.047 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.050 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:38.051 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:38.051 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:38.051 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.052157 17305 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.052 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.052 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.052 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.052 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:38.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.052878 17305 ts_tablet_manager.cc:1403] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.014s
14:24:38.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.063760 17307 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.078624 17307 tablet_bootstrap.cc:654] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.080049 17305 raft_consensus.cc:359] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.081002 17305 raft_consensus.cc:385] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.084 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.084 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.084 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.085 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.085 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.085 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.085 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.081394 17305 raft_consensus.cc:740] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.086807 17305 consensus_queue.cc:260] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.096319 17305 ts_tablet_manager.cc:1434] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.043s	user 0.032s	sys 0.001s
14:24:38.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.099715 17305 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.107929 17307 log.cc:826] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Log is configured to *not* fsync() on all Append() calls
14:24:38.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.109898 17305 tablet_bootstrap.cc:654] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.111387 17309 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.118767 17305 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.119202 17305 ts_tablet_manager.cc:1403] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
14:24:38.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.121910 17309 tablet_bootstrap.cc:654] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.122720 17305 raft_consensus.cc:359] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.124769 17309 log.cc:826] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Log is configured to *not* fsync() on all Append() calls
14:24:38.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.125181 17305 raft_consensus.cc:385] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.125553 17305 raft_consensus.cc:740] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.126375 17305 consensus_queue.cc:260] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.132200 17305 ts_tablet_manager.cc:1434] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
14:24:38.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.132491 17307 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.133038 17307 ts_tablet_manager.cc:1403] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.005s
14:24:38.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.139581 17305 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.147720 17309 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.148165 17309 ts_tablet_manager.cc:1403] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.007s
14:24:38.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.149552 17305 tablet_bootstrap.cc:654] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.156690 17305 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.157181 17305 ts_tablet_manager.cc:1403] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
14:24:38.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.159570 17305 raft_consensus.cc:359] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.160123 17305 raft_consensus.cc:385] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.160359 17305 raft_consensus.cc:740] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.160924 17305 consensus_queue.cc:260] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.162739 17305 ts_tablet_manager.cc:1434] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.163527 17305 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.168978 17305 tablet_bootstrap.cc:654] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.171870 17309 raft_consensus.cc:359] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.172854 17309 raft_consensus.cc:385] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.173175 17309 raft_consensus.cc:740] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.174141 17309 consensus_queue.cc:260] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.180138 17305 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.180817 17305 ts_tablet_manager.cc:1403] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.005s
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.183946 17305 raft_consensus.cc:359] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.186687 17307 raft_consensus.cc:359] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.187604 17307 raft_consensus.cc:385] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.187876 17307 raft_consensus.cc:740] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.188597 17307 consensus_queue.cc:260] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.196097 17307 ts_tablet_manager.cc:1434] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.061s	user 0.031s	sys 0.002s
14:24:38.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.198262 17307 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.198547 17305 raft_consensus.cc:385] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.198781 17305 raft_consensus.cc:740] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.200071 17305 consensus_queue.cc:260] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.202032 17305 ts_tablet_manager.cc:1434] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.202479 17308 raft_consensus.cc:493] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.203002 17308 raft_consensus.cc:515] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.212064 17305 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.219156 17305 tablet_bootstrap.cc:654] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.215008 17307 tablet_bootstrap.cc:654] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.221 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.221 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.222 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.223016 17317 raft_consensus.cc:493] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.223 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.233378 17320 raft_consensus.cc:493] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.234 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.234 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.235 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.238 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.238 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.238 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.238 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.225809 17317 raft_consensus.cc:515] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.240494 17308 leader_election.cc:290] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.242 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.242 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.242187 17320 raft_consensus.cc:515] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.242 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.243 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.243 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.243 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.243 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.244287 17320 leader_election.cc:290] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.253875 17305 tablet_bootstrap.cc:492] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.254309 17305 ts_tablet_manager.cc:1403] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.006s
14:24:38.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.255795 17317 leader_election.cc:290] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.258747 17305 raft_consensus.cc:359] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.259364 17305 raft_consensus.cc:385] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.259619 17305 raft_consensus.cc:740] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.260177 17305 consensus_queue.cc:260] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.265568 16017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.267580 16232 leader_election.cc:343] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.267588 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.269065 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.273093 16232 leader_election.cc:343] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.274789 16232 leader_election.cc:343] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.261176 17307 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.278123 17305 ts_tablet_manager.cc:1434] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
14:24:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.278402 16348 tablet.cc:2404] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.275166 17316 raft_consensus.cc:493] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.279000 17305 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9: Bootstrap starting.
14:24:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.279060 17316 raft_consensus.cc:515] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.285 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.285 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.285 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.285005 17305 tablet_bootstrap.cc:654] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9: Neither blocks nor log segments found. Creating new log.
14:24:38.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.286 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.287 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.287881 17316 leader_election.cc:290] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829), 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821)
14:24:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.277987 17307 ts_tablet_manager.cc:1403] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.005s
14:24:38.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.292361 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.293996 16158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.295768 16157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.300386 17309 ts_tablet_manager.cc:1434] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.152s	user 0.029s	sys 0.032s
14:24:38.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.300765 16233 leader_election.cc:343] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.301215 16233 leader_election.cc:304] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54
14:24:38.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.302241 17317 raft_consensus.cc:2749] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:38.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.302892 16233 leader_election.cc:343] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.305 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:38.305 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:38.305 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:38.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.306 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.306 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.307 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:38.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.307236 17309 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.310163 16233 leader_election.cc:304] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54
14:24:38.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.311172 16233 leader_election.cc:343] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.311 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:38.311 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:38.312 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:38.312 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.312 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.312 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.313 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.313 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.313 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.313 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:38.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.313639 17317 raft_consensus.cc:2749] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:38.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.314440 16233 leader_election.cc:304] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54
14:24:38.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.314648 17307 raft_consensus.cc:359] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.315480 17307 raft_consensus.cc:385] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.315384 17317 raft_consensus.cc:2749] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:38.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.315769 17307 raft_consensus.cc:740] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.317822 16209 tablet.cc:2404] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.319083 17305 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9: No bootstrap required, opened a new log
14:24:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.318621 17307 consensus_queue.cc:260] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.319480 17305 ts_tablet_manager.cc:1403] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.008s
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.322172 17305 raft_consensus.cc:359] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.323424 17307 ts_tablet_manager.cc:1434] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.323634 17305 raft_consensus.cc:385] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.323889 17305 raft_consensus.cc:740] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4dbc1022b094e258f077442852021f9, State: Initialized, Role: FOLLOWER
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.324263 17307 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.324512 17305 consensus_queue.cc:260] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.326298 17305 ts_tablet_manager.cc:1434] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
14:24:38.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.334708 17307 tablet_bootstrap.cc:654] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.347886 17307 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.348248 17307 ts_tablet_manager.cc:1403] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
14:24:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.349551 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700268f26d6f48639ecc59e8eadbfc1a" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.350273 16015 raft_consensus.cc:2468] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.350451 17309 tablet_bootstrap.cc:654] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.350557 17307 raft_consensus.cc:359] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.351147 17307 raft_consensus.cc:385] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.351429 17307 raft_consensus.cc:740] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.352017 17307 consensus_queue.cc:260] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.352634 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700268f26d6f48639ecc59e8eadbfc1a" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.353250 17316 raft_consensus.cc:493] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.353350 16299 raft_consensus.cc:2468] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.353689 17316 raft_consensus.cc:515] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.354 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.355 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.355 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.356 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.356 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.356 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.355587 17316 leader_election.cc:290] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.356 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.356 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.356 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.356 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.357262 17307 ts_tablet_manager.cc:1434] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
14:24:38.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.358433 17307 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.360980 17317 raft_consensus.cc:493] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.361413 17317 raft_consensus.cc:515] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.363492 17317 leader_election.cc:290] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.364809 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.366295 16232 leader_election.cc:343] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.367901 17307 tablet_bootstrap.cc:654] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.372712 17317 raft_consensus.cc:493] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.373101 17317 raft_consensus.cc:515] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.375329 17317 leader_election.cc:290] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.376286 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.377790 16232 leader_election.cc:343] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.384 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.385 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.385 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.385 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.385 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.385840 17307 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.386 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.386565 17307 ts_tablet_manager.cc:1403] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.005s
14:24:38.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.384845 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.390866 17307 raft_consensus.cc:359] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.391808 17307 raft_consensus.cc:385] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.392231 17307 raft_consensus.cc:740] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.393461 17307 consensus_queue.cc:260] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.396642 17307 ts_tablet_manager.cc:1434] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
14:24:38.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.398599 17307 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.407635 17307 tablet_bootstrap.cc:654] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.415390 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:38.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.416103 16299 raft_consensus.cc:2468] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:38.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.421275 16092 leader_election.cc:304] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54; no voters: 
14:24:38.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.422576 17316 raft_consensus.cc:2804] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:38.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.423072 17316 raft_consensus.cc:493] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:38.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.423542 17316 raft_consensus.cc:3060] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.422778 16092 leader_election.cc:343] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.429692 16092 leader_election.cc:304] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612
14:24:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.432051 17328 raft_consensus.cc:2804] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.432554 17328 raft_consensus.cc:493] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:38.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.432389 17316 raft_consensus.cc:515] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.432957 17328 raft_consensus.cc:3060] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.433944 16072 tablet.cc:2404] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.434569 17316 leader_election.cc:290] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Requested vote from peers e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829), 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821)
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.434667 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.435218 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700268f26d6f48639ecc59e8eadbfc1a" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9"
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.435663 16299 raft_consensus.cc:3060] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.436087 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.436626 16159 raft_consensus.cc:2468] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4dbc1022b094e258f077442852021f9 in term 0.
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.438400 16233 leader_election.cc:343] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.438761 16233 leader_election.cc:304] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.439329 17317 raft_consensus.cc:2749] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.439738 16233 leader_election.cc:304] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.440318 17317 raft_consensus.cc:2804] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.440599 17317 raft_consensus.cc:493] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:38.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.440917 17317 raft_consensus.cc:3060] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.445405 16299 raft_consensus.cc:2468] T 700268f26d6f48639ecc59e8eadbfc1a P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.447202 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700268f26d6f48639ecc59e8eadbfc1a" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612"
14:24:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.447690 16015 raft_consensus.cc:3060] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.447535 17317 raft_consensus.cc:515] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.449252 17317 leader_election.cc:290] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 election: Requested vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157)
14:24:38.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.450273 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612"
14:24:38.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.451521 16232 leader_election.cc:343] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.451699 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "e4dbc1022b094e258f077442852021f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54"
14:24:38.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.452188 16159 raft_consensus.cc:3060] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.454 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:38.454 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:38.454 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:38.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.454 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:38.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:38.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:38.455 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:38.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.456930 16015 raft_consensus.cc:2468] T 700268f26d6f48639ecc59e8eadbfc1a P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:38.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.457660 16092 leader_election.cc:304] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9; no voters: 
14:24:38.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.459079 17316 raft_consensus.cc:2804] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election won for term 1
14:24:38.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.460184 16159 raft_consensus.cc:2468] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4dbc1022b094e258f077442852021f9 in term 1.
14:24:38.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.461227 16233 leader_election.cc:304] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612
14:24:38.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.462416 17317 raft_consensus.cc:2804] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election won for term 1
14:24:38.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.462888 17317 raft_consensus.cc:697] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [term 1 LEADER]: Becoming Leader. State: Replica: e4dbc1022b094e258f077442852021f9, State: Running, Role: LEADER
14:24:38.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.463797 17317 consensus_queue.cc:237] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.467429 17309 tablet_bootstrap.cc:492] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.467896 17309 ts_tablet_manager.cc:1403] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.161s	user 0.033s	sys 0.071s
14:24:38.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.470906 17309 raft_consensus.cc:359] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.472009 17309 raft_consensus.cc:385] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.472437 17309 raft_consensus.cc:740] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.474318 17309 consensus_queue.cc:260] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.469677 17328 raft_consensus.cc:515] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.477391 17309 ts_tablet_manager.cc:1434] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
14:24:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.478873 17307 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.479226 17307 ts_tablet_manager.cc:1403] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.028s
14:24:38.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.481882 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612"
14:24:38.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.482465 17307 raft_consensus.cc:359] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.483220 16092 leader_election.cc:343] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821): Illegal state: must be running to vote when last-logged opid is not known
14:24:38.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.483577 17307 raft_consensus.cc:385] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.483875 17307 raft_consensus.cc:740] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.484532 17331 raft_consensus.cc:493] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.484449 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2197643da04c3c8583bdf6a4bd6b34" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9"
14:24:38.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.484792 17316 raft_consensus.cc:697] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [term 1 LEADER]: Becoming Leader. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Running, Role: LEADER
14:24:38.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.484941 16299 raft_consensus.cc:3060] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.485014 17331 raft_consensus.cc:515] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.485690 17316 consensus_queue.cc:237] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } }
14:24:38.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.486016 17328 leader_election.cc:290] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Requested vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.488965 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:38.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.489461 16015 raft_consensus.cc:2468] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:38.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.490705 17309 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.492486 16092 leader_election.cc:304] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54; no voters: 
14:24:38.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.484468 17307 consensus_queue.cc:260] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.498694 17309 tablet_bootstrap.cc:654] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.499683 16299 raft_consensus.cc:2468] T aa2197643da04c3c8583bdf6a4bd6b34 P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.501340 16092 leader_election.cc:304] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9; no voters: 03dc834ad6514e3387738f0060b29612
14:24:38.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.508782 17316 raft_consensus.cc:2804] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:38.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.509091 17316 raft_consensus.cc:493] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:38.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.509456 17316 raft_consensus.cc:3060] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.509297 15822 catalog_manager.cc:5697] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4dbc1022b094e258f077442852021f9 (127.15.52.3). New cstate: current_term: 1 leader_uuid: "e4dbc1022b094e258f077442852021f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: HEALTHY } } }
14:24:38.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.516196 17328 raft_consensus.cc:2804] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election won for term 1
14:24:38.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.516772 17328 raft_consensus.cc:697] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [term 1 LEADER]: Becoming Leader. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Running, Role: LEADER
14:24:38.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.519969 17331 leader_election.cc:290] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.521324 15823 catalog_manager.cc:5697] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 867085016e264a24b5eae3438bda3c54 (127.15.52.2). New cstate: current_term: 1 leader_uuid: "867085016e264a24b5eae3438bda3c54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: HEALTHY } } }
14:24:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.520642 17328 consensus_queue.cc:237] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.535398 17307 ts_tablet_manager.cc:1434] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.000s
14:24:38.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.536357 17307 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54: Bootstrap starting.
14:24:38.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.544806 17309 tablet_bootstrap.cc:492] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.545176 17309 ts_tablet_manager.cc:1403] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.023s
14:24:38.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.549093 17309 raft_consensus.cc:359] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.549784 17309 raft_consensus.cc:385] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.550091 17309 raft_consensus.cc:740] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.550704 17309 consensus_queue.cc:260] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.553539 17309 ts_tablet_manager.cc:1434] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
14:24:38.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.558898 17309 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.565073 17309 tablet_bootstrap.cc:654] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.531448 17316 raft_consensus.cc:515] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.571668 17316 leader_election.cc:290] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Requested vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.581081 17307 tablet_bootstrap.cc:654] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54: Neither blocks nor log segments found. Creating new log.
14:24:38.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:38.596763 16092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.52.3:41829, user_credentials={real_user=slave}} blocked reactor thread for 95452.2us
14:24:38.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.598620 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:38.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.599313 16299 raft_consensus.cc:2468] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:38.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.599344 16015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612"
14:24:38.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.599829 16015 raft_consensus.cc:3060] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.606987 16015 raft_consensus.cc:2468] T 737c32be70c64db39b160c05047fc60d P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:38.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.608999 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737c32be70c64db39b160c05047fc60d" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9"
14:24:38.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.609496 16299 raft_consensus.cc:3060] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.627043 16299 raft_consensus.cc:2468] T 737c32be70c64db39b160c05047fc60d P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.630054 16092 leader_election.cc:304] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54; no voters: 
14:24:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.631011 17336 raft_consensus.cc:2804] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election won for term 1
14:24:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.631494 17336 raft_consensus.cc:697] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [term 1 LEADER]: Becoming Leader. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Running, Role: LEADER
14:24:38.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.632936 17336 consensus_queue.cc:237] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.635514 17309 tablet_bootstrap.cc:492] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.636073 17309 ts_tablet_manager.cc:1403] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.013s
14:24:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.642079 17309 raft_consensus.cc:359] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.642650 17309 raft_consensus.cc:385] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.642925 17309 raft_consensus.cc:740] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.646252 17309 consensus_queue.cc:260] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.648547 17309 ts_tablet_manager.cc:1434] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
14:24:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.649392 17309 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.608443 17307 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54: No bootstrap required, opened a new log
14:24:38.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.657136 17307 ts_tablet_manager.cc:1403] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54: Time spent bootstrapping tablet: real 0.121s	user 0.008s	sys 0.003s
14:24:38.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.662371 17309 tablet_bootstrap.cc:654] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.665 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.666 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.666 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.668 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.668 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.671 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.672 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:38.672 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:38.673 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:38.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.665122 15821 catalog_manager.cc:5697] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 867085016e264a24b5eae3438bda3c54 (127.15.52.2). New cstate: current_term: 1 leader_uuid: "867085016e264a24b5eae3438bda3c54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: UNKNOWN } } }
14:24:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.684407 17307 raft_consensus.cc:359] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.685005 17307 raft_consensus.cc:385] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.685236 17307 raft_consensus.cc:740] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Initialized, Role: FOLLOWER
14:24:38.703 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.703 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.703 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.703 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.703 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.703 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:38.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.701668 17307 consensus_queue.cc:260] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.706233 17219 heartbeater.cc:499] Master 127.15.248.188:46025 was elected leader, sending a full tablet report...
14:24:38.712 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:38.712 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:38.712 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:38.713 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.713 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.713 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:38.713 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.713 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.713 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:38.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.714 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:38.714 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:38.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.713892 15821 catalog_manager.cc:5697] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 867085016e264a24b5eae3438bda3c54 (127.15.52.2). New cstate: current_term: 1 leader_uuid: "867085016e264a24b5eae3438bda3c54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: UNKNOWN } } }
14:24:38.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.726116 17315 raft_consensus.cc:493] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.726646 17315 raft_consensus.cc:515] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.731264 17315 leader_election.cc:290] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.728672 17307 ts_tablet_manager.cc:1434] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
14:24:38.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.786473 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:38.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.787037 16299 raft_consensus.cc:2468] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03dc834ad6514e3387738f0060b29612 in term 0.
14:24:38.792 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:38.793 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:38.793 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:38.793 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.793 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.793 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.794 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:38.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.788693 15950 leader_election.cc:304] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, e4dbc1022b094e258f077442852021f9; no voters: 
14:24:38.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.789559 17315 raft_consensus.cc:2804] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:38.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.789872 17315 raft_consensus.cc:493] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:38.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.790200 17315 raft_consensus.cc:3060] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.799029 17315 raft_consensus.cc:515] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.801880 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9"
14:24:38.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.802381 16299 raft_consensus.cc:3060] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.811622 17315 leader_election.cc:290] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 election: Requested vote from peers 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.812677 16299 raft_consensus.cc:2468] T b0d33a35fb26473baaf15bd936d6b042 P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03dc834ad6514e3387738f0060b29612 in term 1.
14:24:38.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.813066 17309 tablet_bootstrap.cc:492] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.813479 17309 ts_tablet_manager.cc:1403] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.164s	user 0.023s	sys 0.027s
14:24:38.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.813506 17315 raft_consensus.cc:493] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:38.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.815091 15950 leader_election.cc:304] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, e4dbc1022b094e258f077442852021f9; no voters: 
14:24:38.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.814141 17315 raft_consensus.cc:515] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.816039 17309 raft_consensus.cc:359] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.816651 17309 raft_consensus.cc:385] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.816926 17309 raft_consensus.cc:740] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.817504 17309 consensus_queue.cc:260] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.818850 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.821043 17315 leader_election.cc:290] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 867085016e264a24b5eae3438bda3c54 (127.15.52.2:43157), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:38.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.821837 17315 raft_consensus.cc:2804] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Leader election won for term 1
14:24:38.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.825058 17315 raft_consensus.cc:697] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [term 1 LEADER]: Becoming Leader. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Running, Role: LEADER
14:24:38.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.826052 17315 consensus_queue.cc:237] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.831547 17309 ts_tablet_manager.cc:1434] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
14:24:38.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.840255 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.840754 16159 raft_consensus.cc:2468] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03dc834ad6514e3387738f0060b29612 in term 0.
14:24:38.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.846370 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d33a35fb26473baaf15bd936d6b042" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54"
14:24:38.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.846767 16159 raft_consensus.cc:3060] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.852761 16159 raft_consensus.cc:2468] T b0d33a35fb26473baaf15bd936d6b042 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03dc834ad6514e3387738f0060b29612 in term 1.
14:24:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.854745 16159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d59ba9291f4075b09130cbc06ca717" candidate_uuid: "03dc834ad6514e3387738f0060b29612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "867085016e264a24b5eae3438bda3c54" is_pre_election: true
14:24:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.855427 16159 raft_consensus.cc:2393] T f3d59ba9291f4075b09130cbc06ca717 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03dc834ad6514e3387738f0060b29612 in current term 1: Already voted for candidate e4dbc1022b094e258f077442852021f9 in this term.
14:24:38.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.832578 17309 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612: Bootstrap starting.
14:24:38.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.860812 16015 raft_consensus.cc:3060] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.874311 17309 tablet_bootstrap.cc:654] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612: Neither blocks nor log segments found. Creating new log.
14:24:38.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.874867 15821 catalog_manager.cc:5697] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03dc834ad6514e3387738f0060b29612 (127.15.52.1). New cstate: current_term: 1 leader_uuid: "03dc834ad6514e3387738f0060b29612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: UNKNOWN } } }
14:24:38.880 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:38.881 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:38.881 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:38.881 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.881 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:38.882 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.882 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.882 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:38.882 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:38.882 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:38.885 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:38.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.890313 15951 leader_election.cc:304] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03dc834ad6514e3387738f0060b29612; no voters: 867085016e264a24b5eae3438bda3c54, e4dbc1022b094e258f077442852021f9
14:24:38.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.890491 17317 consensus_queue.cc:1048] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:38.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.907493 17309 tablet_bootstrap.cc:492] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612: No bootstrap required, opened a new log
14:24:38.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.907989 17309 ts_tablet_manager.cc:1403] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.001s
14:24:38.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.910832 17309 raft_consensus.cc:359] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.911499 17309 raft_consensus.cc:385] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:38.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.911855 17309 raft_consensus.cc:740] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dc834ad6514e3387738f0060b29612, State: Initialized, Role: FOLLOWER
14:24:38.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.912448 17309 consensus_queue.cc:260] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:38.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.916682 17309 ts_tablet_manager.cc:1434] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
14:24:38.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.924726 17315 raft_consensus.cc:2749] T f3d59ba9291f4075b09130cbc06ca717 P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:38.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:38.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:38.930 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:38.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:38.931 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:38.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:38.932 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:38.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.933333 17320 consensus_queue.cc:1048] T f3d59ba9291f4075b09130cbc06ca717 P e4dbc1022b094e258f077442852021f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:38.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.977622 16015 raft_consensus.cc:3060] T aa2197643da04c3c8583bdf6a4bd6b34 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:38.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:38.998023 17336 consensus_queue.cc:1048] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.011628 17336 consensus_queue.cc:1048] T aa2197643da04c3c8583bdf6a4bd6b34 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.042065 17328 consensus_queue.cc:1048] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.048482 17336 consensus_queue.cc:1048] T 700268f26d6f48639ecc59e8eadbfc1a P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.050 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:39.050 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:39.050 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:39.051 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:39.051 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:39.051 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:39.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:39.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:39.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:39.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:39.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:39.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:39.053 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:39.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.130931 17336 consensus_queue.cc:1048] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.141204 17316 consensus_queue.cc:1048] T 737c32be70c64db39b160c05047fc60d P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.148636 17336 raft_consensus.cc:493] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:39.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.148995 17336 raft_consensus.cc:515] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:39.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.153255 17336 leader_election.cc:290] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:39.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.154830 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612" is_pre_election: true
14:24:39.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.155352 16016 raft_consensus.cc:2468] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:39.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.157143 16092 leader_election.cc:304] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54; no voters: 
14:24:39.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.158155 17336 raft_consensus.cc:2804] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:39.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.158406 17336 raft_consensus.cc:493] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:39.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.158627 17336 raft_consensus.cc:3060] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 0 FOLLOWER]: Advancing to term 1
14:24:39.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.162503 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9" is_pre_election: true
14:24:39.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.163014 16299 raft_consensus.cc:2468] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 0.
14:24:39.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.164842 17336 raft_consensus.cc:515] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:39.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.167212 16016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03dc834ad6514e3387738f0060b29612"
14:24:39.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.167613 16016 raft_consensus.cc:3060] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 0 FOLLOWER]: Advancing to term 1
14:24:39.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.176530 16016 raft_consensus.cc:2468] T 17bc96540e05493cbecf58e57ab846f3 P 03dc834ad6514e3387738f0060b29612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:39.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.177459 16092 leader_election.cc:304] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03dc834ad6514e3387738f0060b29612, 867085016e264a24b5eae3438bda3c54; no voters: 
14:24:39.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.177495 17336 leader_election.cc:290] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [CANDIDATE]: Term 1 election: Requested vote from peers 03dc834ad6514e3387738f0060b29612 (127.15.52.1:34821), e4dbc1022b094e258f077442852021f9 (127.15.52.3:41829)
14:24:39.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.178542 17336 raft_consensus.cc:2804] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 1 FOLLOWER]: Leader election won for term 1
14:24:39.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.178884 17336 raft_consensus.cc:697] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [term 1 LEADER]: Becoming Leader. State: Replica: 867085016e264a24b5eae3438bda3c54, State: Running, Role: LEADER
14:24:39.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.179513 17336 consensus_queue.cc:237] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } }
14:24:39.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.188117 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17bc96540e05493cbecf58e57ab846f3" candidate_uuid: "867085016e264a24b5eae3438bda3c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4dbc1022b094e258f077442852021f9"
14:24:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.189056 16299 raft_consensus.cc:3060] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 0 FOLLOWER]: Advancing to term 1
14:24:39.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.196995 16299 raft_consensus.cc:2468] T 17bc96540e05493cbecf58e57ab846f3 P e4dbc1022b094e258f077442852021f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 867085016e264a24b5eae3438bda3c54 in term 1.
14:24:39.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.199668 15823 catalog_manager.cc:5697] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 867085016e264a24b5eae3438bda3c54 (127.15.52.2). New cstate: current_term: 1 leader_uuid: "867085016e264a24b5eae3438bda3c54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 } health_report { overall_health: UNKNOWN } } }
14:24:39.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.282512 17315 consensus_queue.cc:1048] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.285 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:39.285 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:39.285 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:39.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.286 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.286 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:39.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.300086 17357 consensus_queue.cc:1048] T b0d33a35fb26473baaf15bd936d6b042 P 03dc834ad6514e3387738f0060b29612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "867085016e264a24b5eae3438bda3c54" member_type: VOTER last_known_addr { host: "127.15.52.2" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:39.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:39.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:39.336 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:39.336 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.336 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.336 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.336 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:39.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:39.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:39.465 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:39.465 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:39.465 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:39.466 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.466 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.466 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:39.466 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.466 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.466 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:39.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:39.466 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:39.471 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:39.471 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:39.471 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:39.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:39.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:39.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:39.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:39.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:39.472 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:39.472 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:39.472 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:39.472 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:39.472 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:39.511 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:39.511 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:39.511 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:39.512 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.512 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.512 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.512 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.512 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.512 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.512 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.512 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.512 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.597733 17316 consensus_queue.cc:1048] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03dc834ad6514e3387738f0060b29612" member_type: VOTER last_known_addr { host: "127.15.52.1" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:39.604274 17328 consensus_queue.cc:1048] T 17bc96540e05493cbecf58e57ab846f3 P 867085016e264a24b5eae3438bda3c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4dbc1022b094e258f077442852021f9" member_type: VOTER last_known_addr { host: "127.15.52.3" port: 41829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:39.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:39.816 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:39.816 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:39.816 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:39.816 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.816 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.817 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.817 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.817 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:39.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:39.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:39.817 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:39.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:39.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.004 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:40.009 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:40.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.52.60:41453, [4ms] Sub RPC GetTableLocations: received response from server master-127.15.52.60:41453: OK, deferred=null) after lookup
14:24:40.010 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] connecting to peer
14:24:40.011 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] Successfully connected to peer
14:24:40.022 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.025 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x2129ca96, L:/127.0.0.1:58504 - R:/127.15.52.2:43157] using TOKEN/null
14:24:40.050 [DEBUG - main] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:40.051 [DEBUG - kudu-nio-4] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:40.062 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.066 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x04a49678, L:/127.0.0.1:54472 - R:/127.15.52.3:41829] using TOKEN/null
14:24:40.101 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:40.101 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:40.101 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:40.102 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.102 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.102 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.102 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.102 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:40.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:40.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:40.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:40.138 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.138 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.138 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.138 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.138 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.138 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.138 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.138 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.138 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.138 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:40.194 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:40.195 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:40.195 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:40.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.196 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.196 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.197 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:40.243 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:40.245 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:40.246 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:40.247 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:40.247 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:40.248 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:40.248 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:40.254 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:40.257 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.190
14:24:40.258 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:40.261 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.263 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcada64f5, L:/127.0.0.1:52618 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:40.266 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:40.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=22), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [21ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, deferred=null) after lookup
14:24:40.268 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x04e2f945, L:/127.0.0.1:39682 - R:/127.15.248.190:44713] using SASL/PLAIN
14:24:40.272 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.189
14:24:40.278 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:40.278 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:40.279 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.279 [DEBUG - main] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:40.279 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.52.61:40475(127.15.52.61:40475)] Successfully connected to peer
14:24:40.279 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.52.60:41453(127.15.52.60:41453)] Successfully connected to peer
14:24:40.282 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x49276d3f, L:/127.0.0.1:56008 - R:/127.15.248.189:37707] using SASL/PLAIN
14:24:40.287 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.52.62:42455(127.15.52.62:42455)] Successfully connected to peer
14:24:40.296 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.61
14:24:40.298 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.62
14:24:40.301 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:40.301 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:40.301 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:40.301 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.301 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.301 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.302 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.302 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.302 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:40.302 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.304 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.60
14:24:40.305 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:40.305 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:40.305 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:40.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.306 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.306 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.305 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.306 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:40.306 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.307 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7e750d9f, L:/127.0.0.1:37168 - R:/127.15.52.61:40475] using SASL/PLAIN
14:24:40.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.311 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x205adc5c, L:/127.0.0.1:50884 - R:/127.15.52.62:42455] using SASL/PLAIN
14:24:40.313 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:40.316 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5c8d4159, L:/127.0.0.1:35308 - R:/127.15.52.60:41453] using SASL/PLAIN
14:24:40.318 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:40.318 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=46), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: OK, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: OK, [39ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: OK, deferred=null) after lookup
14:24:40.320 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:40.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:40.324 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.327526 16616 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52618:
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:24:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\0012\000\000\000"
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:24:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:24:40.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:40.331548 16616 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:24:40.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.369 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:40.370 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:40.370 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:40.370 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:40.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:40.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:40.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:40.371 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:40.371 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:40.371 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:40.371 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:40.371 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:40.371 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:40.371 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:40.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.424 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:40.424 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:40.425 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:40.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.425 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.425 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.425 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.425 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.425 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.425 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:40.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.439199 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 368e034c1fc7426db93ff40d2701617d (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:40.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.441875 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368e034c1fc7426db93ff40d2701617d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.442828 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee63373fea547498828c80dac4a046a (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:40.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.443974 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee63373fea547498828c80dac4a046a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.458711 17153 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee63373fea547498828c80dac4a046a (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:40.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.458719 17154 tablet_service.cc:1511] Processing CreateTablet for tablet 368e034c1fc7426db93ff40d2701617d (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:40.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.460716 17153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee63373fea547498828c80dac4a046a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.461465 17154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368e034c1fc7426db93ff40d2701617d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.467660 16790 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee63373fea547498828c80dac4a046a (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
14:24:40.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.469691 16790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee63373fea547498828c80dac4a046a. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.465292 16791 tablet_service.cc:1511] Processing CreateTablet for tablet 368e034c1fc7426db93ff40d2701617d (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
14:24:40.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.479128 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368e034c1fc7426db93ff40d2701617d. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.481957 17424 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:40.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.487790 17425 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:40.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.490139 17424 tablet_bootstrap.cc:654] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.492903 17424 log.cc:826] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: Log is configured to *not* fsync() on all Append() calls
14:24:40.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.500949 17425 tablet_bootstrap.cc:654] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:40.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.502381 17424 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.502928 17424 ts_tablet_manager.cc:1403] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.012s
14:24:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.503062 17425 log.cc:826] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Log is configured to *not* fsync() on all Append() calls
14:24:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.510771 17428 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:40.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.519488 17425 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:40.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.520040 17425 ts_tablet_manager.cc:1403] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.007s
14:24:40.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.521549 17428 tablet_bootstrap.cc:654] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:40.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.523801 17428 log.cc:826] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: Log is configured to *not* fsync() on all Append() calls
14:24:40.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.528220 17428 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:40.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.528689 17428 ts_tablet_manager.cc:1403] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
14:24:40.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.536468 17424 raft_consensus.cc:359] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.537313 17424 raft_consensus.cc:385] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.537623 17424 raft_consensus.cc:740] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:40.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.538661 17424 consensus_queue.cc:260] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.542209 17424 ts_tablet_manager.cc:1434] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.039s	user 0.028s	sys 0.006s
14:24:40.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.555100 17428 raft_consensus.cc:359] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.555974 17428 raft_consensus.cc:385] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.556321 17428 raft_consensus.cc:740] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:40.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.557324 17428 consensus_queue.cc:260] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.560532 17424 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:40.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.567087 17424 tablet_bootstrap.cc:654] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:40.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.563639 17425 raft_consensus.cc:359] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.572008 17425 raft_consensus.cc:385] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.572371 17425 raft_consensus.cc:740] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:40.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.575383 17425 consensus_queue.cc:260] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.579728 17424 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:40.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.580116 17424 ts_tablet_manager.cc:1403] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
14:24:40.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.582494 17424 raft_consensus.cc:359] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.583163 17424 raft_consensus.cc:385] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.583446 17424 raft_consensus.cc:740] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:40.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.585947 17428 ts_tablet_manager.cc:1434] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.057s	user 0.019s	sys 0.027s
14:24:40.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.591024 17428 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:40.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.597430 17428 tablet_bootstrap.cc:654] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:40.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.600055 17425 ts_tablet_manager.cc:1434] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.080s	user 0.029s	sys 0.003s
14:24:40.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.601162 17425 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:40.602 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:40.602 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:40.603 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:40.603 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:40.603 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:40.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:40.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:40.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:40.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:40.604 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:40.604 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:40.604 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:40.605 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:40.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.613670 17428 tablet_bootstrap.cc:492] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:40.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.614177 17428 ts_tablet_manager.cc:1403] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.023s	user 0.002s	sys 0.012s
14:24:40.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.616804 17428 raft_consensus.cc:359] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.617501 17428 raft_consensus.cc:385] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.617889 17428 raft_consensus.cc:740] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:40.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.618636 17428 consensus_queue.cc:260] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.620 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:40.620 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:40.620 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:40.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:40.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.622646 17428 ts_tablet_manager.cc:1434] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
14:24:40.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.631799 17424 consensus_queue.cc:260] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.632701 17430 raft_consensus.cc:493] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:40.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.633190 17430 raft_consensus.cc:515] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.645 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:40.645 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:40.645 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:40.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:40.645169 17021 tablet.cc:2404] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:40.645 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.645 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.646 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:40.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:40.646 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.646 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.646 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:40.646 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:40.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.659443 17430 leader_election.cc:290] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:40.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.669510 17424 ts_tablet_manager.cc:1434] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
14:24:40.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.671862 17425 tablet_bootstrap.cc:654] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:40.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:40.683025 17225 tablet.cc:2404] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.687700 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee63373fea547498828c80dac4a046a" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443" is_pre_election: true
14:24:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.688519 16811 raft_consensus.cc:2468] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 0.
14:24:40.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.692327 17425 tablet_bootstrap.cc:492] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:40.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.689929 17109 leader_election.cc:304] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 504d6bc3351843caab10c4c62664c443; no voters: 
14:24:40.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.692691 17425 ts_tablet_manager.cc:1403] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.004s
14:24:40.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.694339 17430 raft_consensus.cc:2804] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:40.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.694749 17430 raft_consensus.cc:493] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:40.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.695041 17430 raft_consensus.cc:3060] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.704504 17425 raft_consensus.cc:359] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.705133 17425 raft_consensus.cc:385] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:40.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.705386 17425 raft_consensus.cc:740] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:40.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.705981 17425 consensus_queue.cc:260] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.710323 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee63373fea547498828c80dac4a046a" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:40.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.711073 16973 raft_consensus.cc:2468] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 0.
14:24:40.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.718307 17425 ts_tablet_manager.cc:1434] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
14:24:40.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.746367 17430 raft_consensus.cc:515] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.749286 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee63373fea547498828c80dac4a046a" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443"
14:24:40.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.749790 16811 raft_consensus.cc:3060] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.755956 17430 leader_election.cc:290] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Requested vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:40.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.757258 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee63373fea547498828c80dac4a046a" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:40.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.757766 16973 raft_consensus.cc:3060] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.763494 16973 raft_consensus.cc:2468] T 1ee63373fea547498828c80dac4a046a P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 1.
14:24:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.764716 17108 leader_election.cc:304] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:40.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.766616 17430 raft_consensus.cc:2804] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election won for term 1
14:24:40.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.776320 16811 raft_consensus.cc:2468] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 1.
14:24:40.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.788944 17430 raft_consensus.cc:697] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [term 1 LEADER]: Becoming Leader. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Running, Role: LEADER
14:24:40.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.789806 17430 consensus_queue.cc:237] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:40.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:40.809541 16864 tablet.cc:2404] T 1ee63373fea547498828c80dac4a046a P 504d6bc3351843caab10c4c62664c443: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:24:40.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.823454 17431 raft_consensus.cc:493] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:40.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.823964 17431 raft_consensus.cc:515] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.825284 16616 catalog_manager.cc:5697] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20ea43f9145d41cb97a474d459e71881 (127.15.248.131). New cstate: current_term: 1 leader_uuid: "20ea43f9145d41cb97a474d459e71881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: HEALTHY } } }
14:24:40.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.829530 17431 leader_election.cc:290] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:40.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.876699 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368e034c1fc7426db93ff40d2701617d" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:40.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.877321 16973 raft_consensus.cc:2468] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 0.
14:24:40.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.878618 16745 leader_election.cc:304] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504d6bc3351843caab10c4c62664c443, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:40.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:40.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.879633 17431 raft_consensus.cc:2804] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:40.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.880010 17431 raft_consensus.cc:493] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:40.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.880301 17431 raft_consensus.cc:3060] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.886587 17431 raft_consensus.cc:515] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.889899 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368e034c1fc7426db93ff40d2701617d" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:40.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.890379 16973 raft_consensus.cc:3060] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.894043 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368e034c1fc7426db93ff40d2701617d" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.894827 17174 raft_consensus.cc:2468] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 0.
14:24:40.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.897423 16973 raft_consensus.cc:2468] T 368e034c1fc7426db93ff40d2701617d P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 1.
14:24:40.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.898170 17431 leader_election.cc:290] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 election: Requested vote from peers 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:40.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.899094 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368e034c1fc7426db93ff40d2701617d" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:40.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.899134 16745 leader_election.cc:304] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504d6bc3351843caab10c4c62664c443, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:40.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.899533 17174 raft_consensus.cc:3060] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:40.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.905027 17431 raft_consensus.cc:2804] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader election won for term 1
14:24:40.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.905804 17174 raft_consensus.cc:2468] T 368e034c1fc7426db93ff40d2701617d P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 1.
14:24:40.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.906380 17431 raft_consensus.cc:697] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [term 1 LEADER]: Becoming Leader. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Running, Role: LEADER
14:24:40.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.907646 17431 consensus_queue.cc:237] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } }
14:24:40.921 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:40.921 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:40.921 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:40.922 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.922 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.922 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:40.922 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.922 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.922 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:40.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:40.924 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:40.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:40.931740 16616 catalog_manager.cc:5697] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504d6bc3351843caab10c4c62664c443 (127.15.248.129). New cstate: current_term: 1 leader_uuid: "504d6bc3351843caab10c4c62664c443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: HEALTHY } } }
14:24:41.065 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:41.065 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:41.065 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:41.066 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.066 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.066 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.066 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.066 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.066 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.066 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.066 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.066 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.066 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:41.082 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:41.082 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:41.082 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:41.082 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:41.082 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:41.082 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:41.082 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:41.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:41.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:41.082 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:41.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:41.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:41.082 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:41.141 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:41.141 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:41.141 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:41.141 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:41.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:41.141 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:41.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:41.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:41.142 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:41.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:41.142 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:41.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:41.142 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:41.211 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:41.211 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:41.211 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:41.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.212 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.212 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.212 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.212 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.212 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:41.252 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:41.252 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:41.252 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:41.253 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.253 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.253 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.253 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.253 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.253 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.253 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:41.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.262585 17430 consensus_queue.cc:1048] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:41.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.278577 17438 consensus_queue.cc:1048] T 1ee63373fea547498828c80dac4a046a P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:41.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.406263 17431 consensus_queue.cc:1048] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.425541 17453 consensus_queue.cc:1048] T 368e034c1fc7426db93ff40d2701617d P 504d6bc3351843caab10c4c62664c443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:41.472 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:41.472 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:41.472 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:41.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:41.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:41.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:41.472 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:41.650 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:41.651 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:41.651 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:41.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:41.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:41.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:41.652 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:41.749 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:41.750 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:41.750 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:41.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.750 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.750 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.750 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.750 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.750 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.750 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:41.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.830034 16616 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52618:
14:24:41.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\0012\000\000\000\007\001\226\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
14:24:41.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:41.831229 16058 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8c80 after lost signal to thread 15925
14:24:41.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:41.832067 16058 debug-util.cc:398] Leaking SignalData structure 0x7b08000d93e0 after lost signal to thread 16061
14:24:41.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.853 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:41.853 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:41.853 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:41.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.854 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:41.854 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.854 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.854 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:41.854 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:41.854 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:41.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:41.868237 16616 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd804315c8c748db8abc75cb8523f9eb has no consensus state
14:24:41.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:41.869302 16616 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36ddafe3aab54016a5fba6f0b7485fe1 has no consensus state
14:24:41.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:41.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.896199 16791 tablet_service.cc:1511] Processing CreateTablet for tablet fd804315c8c748db8abc75cb8523f9eb (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.897482 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd804315c8c748db8abc75cb8523f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.903600 17153 tablet_service.cc:1511] Processing CreateTablet for tablet fd804315c8c748db8abc75cb8523f9eb (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.904912 17153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd804315c8c748db8abc75cb8523f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:41.906526 16600 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet fd804315c8c748db8abc75cb8523f9eb (table replication_test_table [id=4268c7e5687744f0912da2bc035410d4], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet fd804315c8c748db8abc75cb8523f9eb consensus state has no leader
14:24:41.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.908392 16790 tablet_service.cc:1511] Processing CreateTablet for tablet 36ddafe3aab54016a5fba6f0b7485fe1 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.909466 16790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ddafe3aab54016a5fba6f0b7485fe1. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.912670 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 36ddafe3aab54016a5fba6f0b7485fe1 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.912705 16952 tablet_service.cc:1511] Processing CreateTablet for tablet fd804315c8c748db8abc75cb8523f9eb (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.914729 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ddafe3aab54016a5fba6f0b7485fe1. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.917076 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd804315c8c748db8abc75cb8523f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.931036 17466 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:41.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.936898 17154 tablet_service.cc:1511] Processing CreateTablet for tablet 36ddafe3aab54016a5fba6f0b7485fe1 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
14:24:41.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.938141 17154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ddafe3aab54016a5fba6f0b7485fe1. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:41.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.945540 17466 tablet_bootstrap.cc:654] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:41.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.960387 17469 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:41.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.960937 17466 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:41.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.961314 17466 ts_tablet_manager.cc:1403] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
14:24:41.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.966410 17466 raft_consensus.cc:359] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:41.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.967125 17466 raft_consensus.cc:385] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:41.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.967362 17466 raft_consensus.cc:740] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:41.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.967976 17466 consensus_queue.cc:260] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:41.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.969776 17469 tablet_bootstrap.cc:654] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:41.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.971568 17466 ts_tablet_manager.cc:1434] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
14:24:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.983289 17469 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:41.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.983786 17469 ts_tablet_manager.cc:1403] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
14:24:41.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.992882 17469 raft_consensus.cc:359] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:41.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.993881 17469 raft_consensus.cc:385] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:41.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.994302 17469 raft_consensus.cc:740] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:41.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:41.995134 17469 consensus_queue.cc:260] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.004077 17469 ts_tablet_manager.cc:1434] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.006s
14:24:42.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.015245 17469 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:42.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.016261 17454 raft_consensus.cc:493] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.016745 17454 raft_consensus.cc:515] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.018944 17454 leader_election.cc:290] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:42.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.021433 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:42.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.022503 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:42.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.023599 17469 tablet_bootstrap.cc:654] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:42.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.043453 16745 leader_election.cc:343] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.044391 16745 leader_election.cc:343] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.044839 16745 leader_election.cc:304] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 504d6bc3351843caab10c4c62664c443; no voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024
14:24:42.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.048406 17454 raft_consensus.cc:2749] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:42.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.046819 17469 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:42.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.050071 17469 ts_tablet_manager.cc:1403] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.012s
14:24:42.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.052839 17469 raft_consensus.cc:359] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.053586 17469 raft_consensus.cc:385] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.053978 17469 raft_consensus.cc:740] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:42.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.054311 16615 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: replication_test_table [id=4268c7e5687744f0912da2bc035410d4] alter complete (version 0)
14:24:42.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.054759 17469 consensus_queue.cc:260] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.065351 17469 ts_tablet_manager.cc:1434] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
14:24:42.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.078719 17466 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:42.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.080261 17467 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:42.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.085784 17466 tablet_bootstrap.cc:654] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:42.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.096678 17466 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:42.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.097154 17466 ts_tablet_manager.cc:1403] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
14:24:42.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.097554 17467 tablet_bootstrap.cc:654] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:42.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.099704 17466 raft_consensus.cc:359] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.100306 17466 raft_consensus.cc:385] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.100571 17466 raft_consensus.cc:740] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:42.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.101233 17466 consensus_queue.cc:260] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.104820 17466 ts_tablet_manager.cc:1434] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
14:24:42.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.135320 17467 tablet_bootstrap.cc:492] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:42.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.135715 17467 ts_tablet_manager.cc:1403] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.006s
14:24:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.138535 17467 raft_consensus.cc:359] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.139163 17467 raft_consensus.cc:385] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.139494 17467 raft_consensus.cc:740] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.140880 17467 consensus_queue.cc:260] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.148568 17467 ts_tablet_manager.cc:1434] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
14:24:42.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.149910 17467 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:42.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.155743 17467 tablet_bootstrap.cc:654] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:42.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.160914 17471 raft_consensus.cc:493] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.161368 17471 raft_consensus.cc:515] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.172796 17471 leader_election.cc:290] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.181751 17467 tablet_bootstrap.cc:492] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:42.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.182298 17467 ts_tablet_manager.cc:1403] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.000s
14:24:42.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.185114 17467 raft_consensus.cc:359] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.185833 17467 raft_consensus.cc:385] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.186125 17467 raft_consensus.cc:740] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:42.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.181823 16615 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52618:
14:24:42.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\226\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
14:24:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.190263 17467 consensus_queue.cc:260] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.192790 17467 ts_tablet_manager.cc:1434] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
14:24:42.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.272087 16615 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd804315c8c748db8abc75cb8523f9eb consensus state has no leader
14:24:42.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.272557 16615 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af2ca7a84f9947939e7634f5d21dc977 has no consensus state
14:24:42.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.276461 16615 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36ddafe3aab54016a5fba6f0b7485fe1 consensus state has no leader
14:24:42.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.276928 16615 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48f7daa406e84cd4918f883176872ee3 has no consensus state
14:24:42.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.278723 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:42.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.279237 17174 raft_consensus.cc:2468] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f09c579ac84282aeb07ff0971d1024 in term 0.
14:24:42.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.280326 16907 leader_election.cc:304] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.281078 17471 raft_consensus.cc:2804] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:42.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.281369 17471 raft_consensus.cc:493] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:42.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.281639 17471 raft_consensus.cc:3060] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.284897 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443" is_pre_election: true
14:24:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.285408 16811 raft_consensus.cc:2468] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f09c579ac84282aeb07ff0971d1024 in term 0.
14:24:42.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.288864 17471 raft_consensus.cc:515] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.293036 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.293529 17174 raft_consensus.cc:3060] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.298296 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd804315c8c748db8abc75cb8523f9eb" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443"
14:24:42.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.298722 16811 raft_consensus.cc:3060] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.304056 16811 raft_consensus.cc:2468] T fd804315c8c748db8abc75cb8523f9eb P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f09c579ac84282aeb07ff0971d1024 in term 1.
14:24:42.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.305859 17174 raft_consensus.cc:2468] T fd804315c8c748db8abc75cb8523f9eb P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f09c579ac84282aeb07ff0971d1024 in term 1.
14:24:42.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.313160 17471 leader_election.cc:290] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 election: Requested vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.316449 17471 raft_consensus.cc:493] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.317030 17471 raft_consensus.cc:515] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.321398 17471 leader_election.cc:290] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.322669 16907 leader_election.cc:304] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.324183 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:42.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.324798 17174 raft_consensus.cc:2468] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f09c579ac84282aeb07ff0971d1024 in term 0.
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.325641 17454 raft_consensus.cc:493] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.326050 17454 raft_consensus.cc:515] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.327558 17454 leader_election.cc:290] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.329244 16790 tablet_service.cc:1511] Processing CreateTablet for tablet af2ca7a84f9947939e7634f5d21dc977 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.329447 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.329938 16973 raft_consensus.cc:2468] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 0.
14:24:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.330302 16790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2ca7a84f9947939e7634f5d21dc977. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.331183 16745 leader_election.cc:304] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504d6bc3351843caab10c4c62664c443, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.332139 17454 raft_consensus.cc:2804] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:42.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.332427 17454 raft_consensus.cc:493] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:42.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.332683 17454 raft_consensus.cc:3060] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.333642 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "54f09c579ac84282aeb07ff0971d1024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443" is_pre_election: true
14:24:42.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.334852 17480 raft_consensus.cc:2804] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election won for term 1
14:24:42.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.335945 17480 raft_consensus.cc:697] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [term 1 LEADER]: Becoming Leader. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Running, Role: LEADER
14:24:42.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.336277 16953 tablet_service.cc:1511] Processing CreateTablet for tablet af2ca7a84f9947939e7634f5d21dc977 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.335407 16907 leader_election.cc:304] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.336941 17154 tablet_service.cc:1511] Processing CreateTablet for tablet af2ca7a84f9947939e7634f5d21dc977 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.338274 17154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2ca7a84f9947939e7634f5d21dc977. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.338843 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7daa406e84cd4918f883176872ee3 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.337502 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2ca7a84f9947939e7634f5d21dc977. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.340584 17153 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7daa406e84cd4918f883176872ee3 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.341665 17153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7daa406e84cd4918f883176872ee3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.342780 17454 raft_consensus.cc:515] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.331866 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:42.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.345052 16811 raft_consensus.cc:2393] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54f09c579ac84282aeb07ff0971d1024 in current term 1: Already voted for candidate 504d6bc3351843caab10c4c62664c443 in this term.
14:24:42.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.344874 17173 raft_consensus.cc:2468] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 0.
14:24:42.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.345901 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:42.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.346400 16973 raft_consensus.cc:3060] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.347805 16791 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7daa406e84cd4918f883176872ee3 (DEFAULT_TABLE table=replication_test_table [id=4268c7e5687744f0912da2bc035410d4]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
14:24:42.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.344581 17454 leader_election.cc:290] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 election: Requested vote from peers 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.348824 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7daa406e84cd4918f883176872ee3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.352411 16973 raft_consensus.cc:2468] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 1.
14:24:42.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.350092 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ddafe3aab54016a5fba6f0b7485fe1" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881"
14:24:42.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.353039 17174 raft_consensus.cc:3060] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.353246 16745 leader_election.cc:304] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504d6bc3351843caab10c4c62664c443, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.360874 17454 raft_consensus.cc:2804] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader election won for term 1
14:24:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.362075 17471 raft_consensus.cc:2764] T 36ddafe3aab54016a5fba6f0b7485fe1 P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
14:24:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.362248 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7daa406e84cd4918f883176872ee3. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.362819 17480 consensus_queue.cc:237] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.364982 17466 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.368474 17174 raft_consensus.cc:2468] T 36ddafe3aab54016a5fba6f0b7485fe1 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504d6bc3351843caab10c4c62664c443 in term 1.
14:24:42.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.375231 17466 tablet_bootstrap.cc:654] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:42.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.378659 17469 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:42.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.381366 17454 raft_consensus.cc:697] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [term 1 LEADER]: Becoming Leader. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Running, Role: LEADER
14:24:42.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.382243 17454 consensus_queue.cc:237] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.388589 17469 tablet_bootstrap.cc:654] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:42.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.405831 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.248.131:42259, user_credentials={real_user=slave}} blocked reactor thread for 70456.7us
14:24:42.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.406906 17467 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:42.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.416438 17467 tablet_bootstrap.cc:654] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:42.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.427217 16615 catalog_manager.cc:5697] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130). New cstate: current_term: 1 leader_uuid: "54f09c579ac84282aeb07ff0971d1024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: HEALTHY } } }
14:24:42.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.458426 16616 catalog_manager.cc:5697] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504d6bc3351843caab10c4c62664c443 (127.15.248.129). New cstate: current_term: 1 leader_uuid: "504d6bc3351843caab10c4c62664c443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: UNKNOWN } } }
14:24:42.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.458909 17466 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:42.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.459295 17466 ts_tablet_manager.cc:1403] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.006s
14:24:42.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.461865 17469 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:42.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.461753 17466 raft_consensus.cc:359] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.462263 17469 ts_tablet_manager.cc:1403] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.009s
14:24:42.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.462389 17466 raft_consensus.cc:385] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.462625 17466 raft_consensus.cc:740] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:42.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.463258 17466 consensus_queue.cc:260] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.465441 17467 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:42.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.465803 17467 ts_tablet_manager.cc:1403] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.002s
14:24:42.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.467664 17466 ts_tablet_manager.cc:1434] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
14:24:42.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.468515 17466 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443: Bootstrap starting.
14:24:42.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.470017 17469 raft_consensus.cc:359] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.470593 17469 raft_consensus.cc:385] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.470831 17469 raft_consensus.cc:740] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:42.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.473340 17467 raft_consensus.cc:359] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.474030 17467 raft_consensus.cc:385] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.474311 17467 raft_consensus.cc:740] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:42.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.474861 17469 consensus_queue.cc:260] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.477021 17469 ts_tablet_manager.cc:1434] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.001s
14:24:42.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.477888 17469 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024: Bootstrap starting.
14:24:42.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.480804 17467 consensus_queue.cc:260] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.482998 17467 ts_tablet_manager.cc:1434] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
14:24:42.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.483830 17467 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881: Bootstrap starting.
14:24:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.489254 17469 tablet_bootstrap.cc:654] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024: Neither blocks nor log segments found. Creating new log.
14:24:42.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.496259 17467 tablet_bootstrap.cc:654] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881: Neither blocks nor log segments found. Creating new log.
14:24:42.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.499958 17454 raft_consensus.cc:493] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.500368 17454 raft_consensus.cc:515] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.502969 17430 raft_consensus.cc:493] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.503405 17430 raft_consensus.cc:515] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.505321 17430 leader_election.cc:290] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:42.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.506955 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443" is_pre_election: true
14:24:42.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.507542 16811 raft_consensus.cc:2468] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 0.
14:24:42.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.507783 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:42.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.509236 17109 leader_election.cc:304] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 504d6bc3351843caab10c4c62664c443; no voters: 
14:24:42.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.510110 17108 leader_election.cc:343] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.510887 17430 raft_consensus.cc:2804] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:42.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.511322 17430 raft_consensus.cc:493] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:42.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.511776 17467 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881: No bootstrap required, opened a new log
14:24:42.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.511679 17430 raft_consensus.cc:3060] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.512159 17467 ts_tablet_manager.cc:1403] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
14:24:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.514286 17454 leader_election.cc:290] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989), 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259)
14:24:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.516185 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.517105 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.518313 16745 leader_election.cc:343] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.523737 17430 raft_consensus.cc:515] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.528445 17174 raft_consensus.cc:2393] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 504d6bc3351843caab10c4c62664c443 in current term 1: Already voted for candidate 20ea43f9145d41cb97a474d459e71881 in this term.
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.528537 17467 raft_consensus.cc:359] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.529193 17467 raft_consensus.cc:385] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.529502 17467 raft_consensus.cc:740] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Initialized, Role: FOLLOWER
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.530136 17467 consensus_queue.cc:260] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.531728 16745 leader_election.cc:304] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 504d6bc3351843caab10c4c62664c443; no voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024
14:24:42.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.532717 17469 tablet_bootstrap.cc:492] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024: No bootstrap required, opened a new log
14:24:42.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.533073 17469 ts_tablet_manager.cc:1403] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.005s
14:24:42.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.533213 17454 raft_consensus.cc:3060] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.535748 17469 raft_consensus.cc:359] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.536471 17469 raft_consensus.cc:385] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.536772 17469 raft_consensus.cc:740] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f09c579ac84282aeb07ff0971d1024, State: Initialized, Role: FOLLOWER
14:24:42.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.537514 17469 consensus_queue.cc:260] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.539991 17469 ts_tablet_manager.cc:1434] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
14:24:42.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.541105 17466 tablet_bootstrap.cc:654] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443: Neither blocks nor log segments found. Creating new log.
14:24:42.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.542549 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443"
14:24:42.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.546355 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7daa406e84cd4918f883176872ee3" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:42.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.546890 16973 raft_consensus.cc:3060] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.553598 16614 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6fbe061e0abc4233ac33a3c8e194973e: replication_test_table [id=4268c7e5687744f0912da2bc035410d4] alter complete (version 0)
14:24:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.567266 16973 raft_consensus.cc:2468] T 48f7daa406e84cd4918f883176872ee3 P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 1.
14:24:42.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.570245 17108 leader_election.cc:304] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 
14:24:42.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.577790 17430 leader_election.cc:290] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Requested vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:42.590 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.60:41453(127.15.52.60:41453)] disconnecting while in state READY
14:24:42.590 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.61:40475(127.15.52.61:40475)] disconnecting while in state READY
14:24:42.590 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.62:42455(127.15.52.62:42455)] disconnecting while in state READY
14:24:42.590 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.52.60:41453(127.15.52.60:41453)] handling channelInactive
14:24:42.590 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.52.62:42455(127.15.52.62:42455)] handling channelInactive
14:24:42.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state READY due to: connection closed
14:24:42.591 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:42.590 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state READY due to: connection closed
14:24:42.592 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:24:42.594 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:24:42.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.579891 17491 raft_consensus.cc:2804] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election won for term 1
14:24:42.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.610491 17491 raft_consensus.cc:697] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [term 1 LEADER]: Becoming Leader. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Running, Role: LEADER
14:24:42.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.544873 17454 raft_consensus.cc:2749] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:42.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.611281 17491 consensus_queue.cc:237] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } }
14:24:42.612 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.52.61:40475(127.15.52.61:40475)] handling channelInactive
14:24:42.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state READY due to: connection closed
14:24:42.612 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:42.612 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.188:46025(127.15.248.188:46025)] disconnecting while in state READY
14:24:42.612 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.190:44713(127.15.248.190:44713)] disconnecting while in state READY
14:24:42.613 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.189:37707(127.15.248.189:37707)] disconnecting while in state READY
14:24:42.613 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:42.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:42.613 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:42.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:42.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:42.616 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
14:24:42.616 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:24:42.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.621480 17467 ts_tablet_manager.cc:1434] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881: Time spent starting tablet: real 0.109s	user 0.030s	sys 0.042s
14:24:42.622 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:42.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:42.623 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:24:42.624 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:24:42.625 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:24:42.625 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:24:42.625 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:24:42.625 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:24:42.625 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:24:42.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.644630 16811 raft_consensus.cc:2468] T 48f7daa406e84cd4918f883176872ee3 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 1.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:24:42.666 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:24:42.666 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:24:42.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.677017 17466 tablet_bootstrap.cc:492] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443: No bootstrap required, opened a new log
14:24:42.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.677652 17466 ts_tablet_manager.cc:1403] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.001s
14:24:42.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.683799 17490 raft_consensus.cc:493] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:42.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.684303 17490 raft_consensus.cc:515] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.686395 17490 leader_election.cc:290] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:42.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.693900 16616 catalog_manager.cc:5697] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20ea43f9145d41cb97a474d459e71881 (127.15.248.131). New cstate: current_term: 1 leader_uuid: "20ea43f9145d41cb97a474d459e71881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: HEALTHY } } }
14:24:42.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.714936 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443" is_pre_election: true
14:24:42.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.717999 17109 leader_election.cc:343] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.726230 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:42.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.726796 16973 raft_consensus.cc:2468] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 0.
14:24:42.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.729809 17108 leader_election.cc:304] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 504d6bc3351843caab10c4c62664c443
14:24:42.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.730597 17491 raft_consensus.cc:2804] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:24:42.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.730932 17491 raft_consensus.cc:493] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:24:42.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.731262 17491 raft_consensus.cc:3060] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.740918 17491 raft_consensus.cc:515] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.743703 17491 leader_election.cc:290] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Requested vote from peers 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:42.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.758949 16811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504d6bc3351843caab10c4c62664c443"
14:24:42.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.760094 17109 leader_election.cc:343] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 504d6bc3351843caab10c4c62664c443 (127.15.248.129:36421): Illegal state: must be running to vote when last-logged opid is not known
14:24:42.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.780072 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "20ea43f9145d41cb97a474d459e71881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024"
14:24:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.781107 16973 raft_consensus.cc:3060] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 0 FOLLOWER]: Advancing to term 1
14:24:42.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:42.795854 17495 log.cc:927] Time spent T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
14:24:42.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.797923 17466 raft_consensus.cc:359] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.810288 17466 raft_consensus.cc:385] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:24:42.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.806353 16973 raft_consensus.cc:2468] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20ea43f9145d41cb97a474d459e71881 in term 1.
14:24:42.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.811641 17108 leader_election.cc:304] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024; no voters: 504d6bc3351843caab10c4c62664c443
14:24:42.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.812994 17491 raft_consensus.cc:2804] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 1 FOLLOWER]: Leader election won for term 1
14:24:42.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.813616 17491 raft_consensus.cc:697] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [term 1 LEADER]: Becoming Leader. State: Replica: 20ea43f9145d41cb97a474d459e71881, State: Running, Role: LEADER
14:24:42.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.814765 17491 consensus_queue.cc:237] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.821151 17466 raft_consensus.cc:740] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504d6bc3351843caab10c4c62664c443, State: Initialized, Role: FOLLOWER
14:24:42.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.826886 17466 consensus_queue.cc:260] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:42.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.841845 17466 ts_tablet_manager.cc:1434] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.000s
14:24:42.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.843297 16614 catalog_manager.cc:5697] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20ea43f9145d41cb97a474d459e71881 (127.15.248.131). New cstate: current_term: 1 leader_uuid: "20ea43f9145d41cb97a474d459e71881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } health_report { overall_health: UNKNOWN } } }
14:24:42.896 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:42.909 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:42.909 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:42.909 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:42.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:42.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:42.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:42.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:42.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:42.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:42.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:42.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:42.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:42.911 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:42.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.911041 17480 consensus_queue.cc:1048] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:42.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:42.918669 17454 consensus_queue.cc:1048] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:43.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.006603 17480 consensus_queue.cc:1048] T fd804315c8c748db8abc75cb8523f9eb P 54f09c579ac84282aeb07ff0971d1024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:24:43.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.038810 17510 consensus_queue.cc:1048] T 36ddafe3aab54016a5fba6f0b7485fe1 P 504d6bc3351843caab10c4c62664c443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:24:43.044 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:43.045 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:43.045 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:43.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:43.048 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:43.048 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:43.048 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:43.048 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.049 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.049 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.049 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.049 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:43.062 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:24:43.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:43.060755 16745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.248.131:42259, user_credentials={real_user=slave}} blocked reactor thread for 61150.8us
14:24:43.092 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:43.093 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:43.093 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:43.093 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.093 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.095 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:43.101 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:43.101 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:43.101 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:43.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.102 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.104 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:43.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.237272 17491 consensus_queue.cc:1048] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:43.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.238461 17507 raft_consensus.cc:493] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:24:43.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.238919 17507 raft_consensus.cc:515] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 } } peers { permanent_uuid: "20ea43f9145d41cb97a474d459e71881" member_type: VOTER last_known_addr { host: "127.15.248.131" port: 42259 } } peers { permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 } }
14:24:43.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.240650 17507 leader_election.cc:290] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20ea43f9145d41cb97a474d459e71881 (127.15.248.131:42259), 54f09c579ac84282aeb07ff0971d1024 (127.15.248.130:41989)
14:24:43.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.242497 16973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f09c579ac84282aeb07ff0971d1024" is_pre_election: true
14:24:43.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.243222 16973 raft_consensus.cc:2393] T af2ca7a84f9947939e7634f5d21dc977 P 54f09c579ac84282aeb07ff0971d1024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 504d6bc3351843caab10c4c62664c443 in current term 1: Already voted for candidate 20ea43f9145d41cb97a474d459e71881 in this term.
14:24:43.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.244254 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2ca7a84f9947939e7634f5d21dc977" candidate_uuid: "504d6bc3351843caab10c4c62664c443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20ea43f9145d41cb97a474d459e71881" is_pre_election: true
14:24:43.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:43.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:43.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:43.246 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.246068 16745 leader_election.cc:304] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 504d6bc3351843caab10c4c62664c443; no voters: 20ea43f9145d41cb97a474d459e71881, 54f09c579ac84282aeb07ff0971d1024
14:24:43.247 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.246925 17507 raft_consensus.cc:3060] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 0 FOLLOWER]: Advancing to term 1
14:24:43.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.247 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.247 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.247 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:43.248 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:24:43.248 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:24:43.248 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:24:43.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.274065 17507 raft_consensus.cc:2749] T af2ca7a84f9947939e7634f5d21dc977 P 504d6bc3351843caab10c4c62664c443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:24:43.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.280122 17491 consensus_queue.cc:1048] T 48f7daa406e84cd4918f883176872ee3 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:43.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.284031 17491 consensus_queue.cc:1048] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f09c579ac84282aeb07ff0971d1024" member_type: VOTER last_known_addr { host: "127.15.248.130" port: 41989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:43.299 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:24:43.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:43.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:43.334564 17491 consensus_queue.cc:1048] T af2ca7a84f9947939e7634f5d21dc977 P 20ea43f9145d41cb97a474d459e71881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504d6bc3351843caab10c4c62664c443" member_type: VOTER last_known_addr { host: "127.15.248.129" port: 36421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:24:43.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:43.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:43.535 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:43.535 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:43.535 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:43.535 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.536 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.536 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.536 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.536 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.537 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.537 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:43.576 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:43.576 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:43.577 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:43.577 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:43.578 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.578 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.578 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:43.578 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.578 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.578 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:43.578 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:43.629 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:43.629 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:43.630 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:43.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.630 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.630 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:43.630 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.630 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.630 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:43.630 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.630 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.630 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:43.630 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:43.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:43.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:43.861 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:43.861 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:43.861 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:43.862 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.862 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.862 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:43.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:43.863 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.863 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.863 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:43.863 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:43.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:43.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:43.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:43.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.864 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:43.865 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:43.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:43.865 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:43.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.070 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.071 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.071 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.071 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.072 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:44.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.392 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.392 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.393 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.393 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.393 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.393 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.393 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.393 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.394 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:44.448 [INFO - flink-pekko.actor.default-dispatcher-6] (Slf4jLogger.scala:117) Slf4jLogger started
14:24:44.456 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.456 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.457 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.459 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.459 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:44.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:44.476118 15773 debug-util.cc:398] Leaking SignalData structure 0x7b0800098040 after lost signal to thread 15708
14:24:44.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:44.476913 15773 debug-util.cc:398] Leaking SignalData structure 0x7b0800080c80 after lost signal to thread 15776
14:24:44.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:44.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:44.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:44.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:44.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:44.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:44.492 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:44.492 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:44.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:44.492 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:44.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:44.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:44.492 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:44.638 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:24:44.674 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:24:44.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:44.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:44.689 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:44.690 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:44.690 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:44.690 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:44.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:44.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:44.691 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:44.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:44.691 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:44.691 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:44.691 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:44.720 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.721 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.721 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.721 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.722 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:44.725 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:44.725 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:44.725 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:44.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.727 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:44.771 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:24:44.800 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:24:44.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.801 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.801 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.802 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.802 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.802 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.802 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.802 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.802 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.802 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.803 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:44.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.824 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:44.824 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:44.825 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:44.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:44.825 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.825 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.825 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:44.825 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.825 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.825 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:44.825 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:44.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.848 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:24:44.867 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:24:44.868 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:24:44.868 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:24:44.869 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:24:44.869 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:24:44.871 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:24:44.871 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:24:44.871 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:24:44.872 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:24:44.872 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:24:44.872 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:24:44.874 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:24:44.874 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:24:44.874 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:24:44.874 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:24:44.875 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:24:44.875 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:24:44.875 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:24:44.875 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:24:44.875 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:24:44.875 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:24:44.876 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:24:44.876 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:24:44.876 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:24:44.876 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_562f2479f8a1aa6af389e897225ab6e7/blobStorage
14:24:44.882 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:44.882 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:44.882 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:44.882 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:44.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:44.883 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:44.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:44.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:44.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:44.883 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:44.883 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:44.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:44.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:44.884 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:44.889 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:40987 - max concurrent requests: 50 - max backlog: 1000
14:24:44.895 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_562f2479f8a1aa6af389e897225ab6e7/blobStorage
14:24:44.904 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_562f2479f8a1aa6af389e897225ab6e7/blobStorage
14:24:44.905 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:24:44.906 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: a7ca8bbb-4b0d-418d-a45d-2b83604b848e
14:24:44.907 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 34 GB (70.83% usable)
14:24:44.908 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-f11dc725-6153-41d0-b793-fc52f27c2bfd
14:24:44.923 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-0846b2db-cac4-4c90-bd72-a0e0cc4223c8
14:24:44.985 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:44.986 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:44.986 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:44.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:44.986 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.986 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:44.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:44.987 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:45.116 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:24:45.117 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:24:45.117 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:24:45.117 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:24:45.121 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:24:45.126 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_12 .
14:24:45.144 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:127) Start job leader service.
14:24:45.144 [INFO - flink-pekko.actor.default-dispatcher-6] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-b4d33334-4b62-44c9-a3a3-77ae8ad199fb
14:24:45.152 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:24:45.152 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:24:45.160 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:45.161 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:45.161 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:45.161 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:45.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:45.162 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:45.162 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:45.162 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:45.162 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:45.162 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:45.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:45.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:45.163 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:45.202 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:24:45.202 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:24:45.235 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:35311
14:24:45.235 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:24:45.253 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:24:45.253 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:35311 was granted leadership with leaderSessionID=40bd98b6-1fa5-466d-8a72-af509b70a5d7
14:24:45.253 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:35311 , session=40bd98b6-1fa5-466d-8a72-af509b70a5d7
14:24:45.262 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:24:45.262 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:24:45.262 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 1185d101-d572-48ad-a601-303590284b1f. Creating new DispatcherLeaderProcess.
14:24:45.262 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:24:45.266 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:24:45.270 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:24:45.270 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:24:45.271 [INFO - pool-195-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 85dc528d-e6de-482c-9f64-ec1884bc3da7.
14:24:45.272 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_13 .
14:24:45.273 [INFO - pool-195-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_14 .
14:24:45.278 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_13 , session=1185d101-d572-48ad-a601-303590284b1f
14:24:45.280 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
14:24:45.280 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:24:45.281 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:24:45.281 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:24:45.281 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:24:45.282 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_14 , session=85dc528d-e6de-482c-9f64-ec1884bc3da7
14:24:45.283 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(9f64ec1884bc3da785dc528de6de482c).
14:24:45.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.309 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:24:45.318 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID a7ca8bbb-4b0d-418d-a45d-2b83604b848e (pekko://flink/user/rpc/taskmanager_12) at ResourceManager
14:24:45.319 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.320 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.320 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-2c28d6d49adcc0d598680955c9f9304b'.
14:24:45.320 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 2c28d6d49adcc0d598680955c9f9304b was granted leadership with leader id e070e224-fa33-41db-a0c3-a3f6802a24da. Creating new JobMasterServiceProcess.
14:24:45.320 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_14 under registration id 8f95a1c8b95bee41b03ece08d59e33b3.
14:24:45.321 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor a7ca8bbb-4b0d-418d-a45d-2b83604b848e under 8f95a1c8b95bee41b03ece08d59e33b3 at the slot manager.
14:24:45.323 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_15 .
14:24:45.326 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.326 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.327 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 828bca02842c6378884ce240926f0f48 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.327 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.327 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:24:45.328 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:24:45.328 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16d10234
14:24:45.328 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:45.328 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:24:45.329 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:24:45.330 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@1017be4f for Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b).
14:24:45.330 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_15 , session=e070e224-fa33-41db-a0c3-a3f6802a24da
14:24:45.334 [INFO - flink-pekko.actor.default-dispatcher-10] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (2c28d6d49adcc0d598680955c9f9304b) under job master id a0c3a3f6802a24dae070e224fa3341db.
14:24:45.335 [INFO - flink-pekko.actor.default-dispatcher-10] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:45.337 [DEBUG - flink-pekko.actor.default-dispatcher-10] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.338 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:24:45.338 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state CREATED to RUNNING.
14:24:45.342 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:24:45.342 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:24:45.343 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:24:45.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.343 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:24:45.344 [INFO - flink-pekko.actor.default-dispatcher-10] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(9f64ec1884bc3da785dc528de6de482c)
14:24:45.346 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:24:45.346 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager a0c3a3f6802a24dae070e224fa3341db@pekko://flink/user/rpc/jobmanager_15 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.350 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1015) Registered job manager a0c3a3f6802a24dae070e224fa3341db@pekko://flink/user/rpc/jobmanager_15 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.350 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:45.350 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:45.351 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.52.61:40475(127.15.52.61:40475)] Successfully connected to peer
14:24:45.352 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 9f64ec1884bc3da785dc528de6de482c.
14:24:45.353 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:45.353 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:45.358 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.52.60:41453(127.15.52.60:41453)] Successfully connected to peer
14:24:45.362 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.52.62:42455(127.15.52.62:42455)] Successfully connected to peer
14:24:45.363 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.60
14:24:45.376 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.61
14:24:45.379 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:45.380 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:45.380 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:45.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.384 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.386 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3c5e89c3, L:/127.0.0.1:37184 - R:/127.15.52.61:40475] using SASL/PLAIN
14:24:45.388 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 2c28d6d49adcc0d598680955c9f9304b
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager a7ca8bbb-4b0d-418d-a45d-2b83604b848e
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:24:45.388 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:45.389 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot b0ebe80ca87f65b8b30949f69aa39fc7 from a7ca8bbb-4b0d-418d-a45d-2b83604b848e for job 2c28d6d49adcc0d598680955c9f9304b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.389 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1fcaa447963e1a1f1f58c31170394ad7 from a7ca8bbb-4b0d-418d-a45d-2b83604b848e for job 2c28d6d49adcc0d598680955c9f9304b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.389 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 10c63737e2970d1d7edb16b3b001e5f2 from a7ca8bbb-4b0d-418d-a45d-2b83604b848e for job 2c28d6d49adcc0d598680955c9f9304b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.390 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1149) Receive slot request b0ebe80ca87f65b8b30949f69aa39fc7 for job 2c28d6d49adcc0d598680955c9f9304b from resource manager with leader id 9f64ec1884bc3da785dc528de6de482c.
14:24:45.390 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:321) Allocated slot for b0ebe80ca87f65b8b30949f69aa39fc7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.390 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 8e9538df5a0dfbedb16829666ce7ddc2 from a7ca8bbb-4b0d-418d-a45d-2b83604b848e for job 2c28d6d49adcc0d598680955c9f9304b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.391 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.62
14:24:45.396 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.399 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x417cbc5b, L:/127.0.0.1:52624 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:45.402 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.403 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.405 [DEBUG - main] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:45.406 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd96b8ba3, L:/127.0.0.1:35312 - R:/127.15.52.60:41453] using SASL/PLAIN
14:24:45.407 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf22889b0, L:/127.0.0.1:50894 - R:/127.15.52.62:42455] using SASL/PLAIN
14:24:45.407 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.408 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [23ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, deferred=null) after lookup
14:24:45.411 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.411 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=69), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: OK, [60ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: OK, deferred=null) after lookup
14:24:45.412 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.415 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:45.417 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:45.417 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:45.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:45.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:45.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:45.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:45.418 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:45.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.248.188:46025, [5ms] Sub RPC GetTableLocations: received response from server master-127.15.248.188:46025: OK, deferred=null)) after lookup
14:24:45.419 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] connecting to peer
14:24:45.420 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:45.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:45.440 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:45.454 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:45.459 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.463 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultJobLeaderService.java:192) Add job 2c28d6d49adcc0d598680955c9f9304b for job leader monitoring.
14:24:45.463 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_15 with leader id e070e224-fa33-41db-a0c3-a3f6802a24da.
14:24:45.463 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1149) Receive slot request 1fcaa447963e1a1f1f58c31170394ad7 for job 2c28d6d49adcc0d598680955c9f9304b from resource manager with leader id 9f64ec1884bc3da785dc528de6de482c.
14:24:45.463 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:321) Allocated slot for 1fcaa447963e1a1f1f58c31170394ad7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.464 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1149) Receive slot request 10c63737e2970d1d7edb16b3b001e5f2 for job 2c28d6d49adcc0d598680955c9f9304b from resource manager with leader id 9f64ec1884bc3da785dc528de6de482c.
14:24:45.464 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:321) Allocated slot for 10c63737e2970d1d7edb16b3b001e5f2 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.464 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1149) Receive slot request 8e9538df5a0dfbedb16829666ce7ddc2 for job 2c28d6d49adcc0d598680955c9f9304b from resource manager with leader id 9f64ec1884bc3da785dc528de6de482c.
14:24:45.465 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:321) Allocated slot for 8e9538df5a0dfbedb16829666ce7ddc2 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:24:45.466 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:24:45.467 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_15 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.468 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.468 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.469 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:24:45.469 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 10c63737e2970d1d7edb16b3b001e5f2
14:24:45.469 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 10c63737e2970d1d7edb16b3b001e5f2.
14:24:45.470 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:45.470 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:24:45.470 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 2c28d6d49adcc0d598680955c9f9304b
14:24:45.471 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 10c63737e2970d1d7edb16b3b001e5f2.
14:24:45.471 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3f13690f, L:/127.0.0.1:56012 - R:/127.15.248.189:37707] using TOKEN/null
14:24:45.483 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.504 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1f2da2be, L:/127.0.0.1:39694 - R:/127.15.248.190:44713] using TOKEN/null
14:24:45.505 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] Successfully connected to peer
14:24:45.511 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:24:45.511 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 8e9538df5a0dfbedb16829666ce7ddc2
14:24:45.514 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:24:45.514 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id b0ebe80ca87f65b8b30949f69aa39fc7
14:24:45.518 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:24:45.518 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 1fcaa447963e1a1f1f58c31170394ad7
14:24:45.519 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:24:45.521 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 8e9538df5a0dfbedb16829666ce7ddc2.
14:24:45.523 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:24:45.523 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:24:45.527 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5685aacb
14:24:45.527 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:45.527 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:24:45.527 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:24:45.528 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:24:45.533 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot b0ebe80ca87f65b8b30949f69aa39fc7.
14:24:45.534 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:24:45.534 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:24:45.534 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2e845bd
14:24:45.534 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:45.535 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:24:45.535 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:24:45.535 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id b0ebe80ca87f65b8b30949f69aa39fc7.
14:24:45.535 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:24:45.543 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.545 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46a3cb38
14:24:45.548 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.553 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45d99784
14:24:45.555 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.569 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.571 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 10c63737e2970d1d7edb16b3b001e5f2.
14:24:45.571 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:24:45.571 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot b0ebe80ca87f65b8b30949f69aa39fc7.
14:24:45.572 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 1fcaa447963e1a1f1f58c31170394ad7.
14:24:45.572 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 1fcaa447963e1a1f1f58c31170394ad7.
14:24:45.573 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 1fcaa447963e1a1f1f58c31170394ad7.
14:24:45.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:24:45.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:24:45.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@173e9cc1
14:24:45.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:45.578 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:24:45.579 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:24:45.580 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:24:45.580 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfba3e791, L:/127.0.0.1:36016 - R:/127.15.248.129:36421] using TOKEN/null
14:24:45.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@70cb251a
14:24:45.586 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.587 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:45.587 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:45.587 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:24:45.587 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:24:45.588 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@551b7f34
14:24:45.588 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:45.588 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:45.588 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:24:45.588 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:24:45.588 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:24:45.589 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:45.592 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5fb9f09a
14:24:45.593 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:45.594 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.595 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:45.604 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:45.607 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.607 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:45.609 [DEBUG - main] (Connection.java:748) [peer 54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)] connecting to peer
14:24:45.610 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:45.612 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.617 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x68e02a3f, L:/127.0.0.1:52636 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:45.621 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:45.625 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:45.631 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:45.631 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=85), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, deferred=null) after lookup
14:24:45.635 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.190
14:24:45.638 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.640 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@482c91bc
14:24:45.642 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:24:45.642 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:24:45.645 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:45.645 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1b32e8ff, L:/127.0.0.1:52648 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:45.653 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:24:45.656 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.659 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.661 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x20e2948b, L:/127.0.0.1:56028 - R:/127.15.248.189:37707] using TOKEN/null
14:24:45.662 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa4918c3b, L:/127.0.0.1:39706 - R:/127.15.248.190:44713] using SASL/PLAIN
14:24:45.666 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:45.667 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:45.672 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:45.675 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:45.676 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:45.678 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.190
14:24:45.679 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:45.682 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.189
14:24:45.690 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.694 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.695 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.698 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x631a441c, L:/127.0.0.1:56034 - R:/127.15.248.189:37707] using SASL/PLAIN
14:24:45.699 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:24:45.699 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6c4edfaec1a49c0825409ce621d017f9174e3bea6bbc3406c6e8e731b9c3d1bf'}]
14:24:45.701 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.701 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x85158a66, L:/127.0.0.1:52654 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:45.704 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.704 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=118), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [107ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: OK, [109ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, deferred=null) after lookup
14:24:45.706 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1f2773b7, L:/127.0.0.1:39716 - R:/127.15.248.190:44713] using SASL/PLAIN
14:24:45.710 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.711 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:45.711 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:45.713 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.713 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6294459
14:24:45.722 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:45.723 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:45.723 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:45.723 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:45.723 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:45.723 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:45.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:45.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:45.724 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:45.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:45.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:45.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:45.724 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:45.730 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:24:45.730 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.248.188:46025(127.15.248.188:46025)] Successfully connected to peer
14:24:45.739 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.188
14:24:45.738 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)] Successfully connected to peer
14:24:45.766 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:24:45.766 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:24:45.766 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:24:45.778 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.779 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:45.783 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.786 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x83238d1f, L:/127.0.0.1:52656 - R:/127.15.248.188:46025] using SASL/PLAIN
14:24:45.787 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:45.788 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x08c6a80c, L:/127.0.0.1:48626 - R:/127.15.248.130:41989] using TOKEN/null
14:24:45.793 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.793 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=237), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, deferred=null) after lookup
14:24:45.797 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:45.799 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.190
14:24:45.801 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.803 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.803 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b44a599
14:24:45.806 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:24:45.806 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:24:45.809 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:45.809 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.810 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.811 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:45.811 [DEBUG - main] (Connection.java:748) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] connecting to peer
14:24:45.821 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:24:45.822 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.248.190:44713(127.15.248.190:44713)] Successfully connected to peer
14:24:45.829 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.829 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:24:45.830 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=235), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [144ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: OK, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, deferred=null) after lookup
14:24:45.830 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.248.189:37707(127.15.248.189:37707)] Successfully connected to peer
14:24:45.836 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:24:45.836 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.836 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b97880c054474c0f4264af8d7d0c2d675d5b39d97df452ef721d4503f5f79f1a'}]
14:24:45.838 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.841 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:45.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b25e83c
14:24:45.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.852 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:45.853 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299998, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:45.853 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:45.854 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:45.854 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:45.854 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:45.854 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:45.854 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:45.855 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:45.855 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:45.855 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:45.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:45.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:45.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:45.855 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:45.862 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa6d0ae61, L:/127.0.0.1:39722 - R:/127.15.248.190:44713] using SASL/PLAIN
14:24:45.867 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.868 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:45.871 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6b655801, L:/127.0.0.1:56036 - R:/127.15.248.189:37707] using TOKEN/null
14:24:45.874 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.248.190
14:24:45.881 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] Successfully connected to peer
14:24:45.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:45.883 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.888 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.892 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc617f62e, L:/127.0.0.1:56038 - R:/127.15.248.189:37707] using TOKEN/null
14:24:45.893 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x829ac4b9, L:/127.0.0.1:39726 - R:/127.15.248.190:44713] using SASL/PLAIN
14:24:45.904 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:45.909 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:24:45.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:24:45.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:24:45.915 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.918 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:45.919 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf25c4451, L:/127.0.0.1:54482 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:45.922 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x153da299, L:/127.0.0.1:47544 - R:/127.15.248.131:42259] using TOKEN/null
14:24:45.922 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:24:45.923 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='08ccfc96655806b31b0c2f5b5136da63bb1196d0e1b7c20e2b80bfd98a6b33ab'}]
14:24:45.923 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:45.924 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:24:45.924 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='817bec26811de89160161deb46b14f143c670db8a186d4fd54191b342bff9918'}]
14:24:45.924 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.925 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:45.930 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.930 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:45.938 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.938 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:45.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:45.949 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.949 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:45.950 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:45.952 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:45.970 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=700268f26d6f48639ecc59e8eadbfc1a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:45.970 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6c4edfaec1a49c0825409ce621d017f9174e3bea6bbc3406c6e8e731b9c3d1bf]
14:24:45.971 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:24:45.980 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:24:45.980 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:45.980 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:45.981 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:45.981 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:45.981 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:45.981 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:45.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:45.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:45.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:45.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:45.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:45.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:45.982 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:45.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:45.982 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:45.982 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:45.983 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6c4edfaec1a49c0825409ce621d017f9174e3bea6bbc3406c6e8e731b9c3d1bf]
14:24:45.984 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:45.984 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:45.984 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:45.984 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:45.985 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:45.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:45.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:45.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:45.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:45.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:45.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:45.990 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:45.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:45.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:45.992 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:45.992 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:45.992 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:45.992 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:45.992 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:45.996 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:46.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.007 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:24:46.007 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:24:46.008 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6c4edfaec1a49c0825409ce621d017f9174e3bea6bbc3406c6e8e731b9c3d1bf finished by subtask 1; deferring removal (restored in pending)
14:24:46.010 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='18e713c972120db2000456d12e515d3be6445b68a5a32615ddc1db33701b0481'}]
14:24:46.011 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:46.013 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.013 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.019 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.019 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.022 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:46.028 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.028 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.030 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:46.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.034 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:46.035 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:46.035 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:46.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.036 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.036 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.036 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:46.039 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.039 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.043 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114286041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:46.050 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.055 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=253, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4851dae5, flushNotification=Deferred@1394155966(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:24:46.055 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] connecting to peer
14:24:46.056 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:24:46.069 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}]
14:24:46.069 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcaf23d56, L:/127.0.0.1:54492 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:46.071 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:46.076 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:46.076 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] Successfully connected to peer
14:24:46.077 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.078 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [b97880c054474c0f4264af8d7d0c2d675d5b39d97df452ef721d4503f5f79f1a]
14:24:46.089 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.092 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcb64e48f, L:/127.0.0.1:54500 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:46.101 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.101 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.106 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.106 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.114 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.114 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.124 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.124 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.126 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b97880c054474c0f4264af8d7d0c2d675d5b39d97df452ef721d4503f5f79f1a]
14:24:46.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:46.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:46.128 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.129 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:46.129 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [817bec26811de89160161deb46b14f143c670db8a186d4fd54191b342bff9918]
14:24:46.129 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:46.129 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b97880c054474c0f4264af8d7d0c2d675d5b39d97df452ef721d4503f5f79f1a finished by subtask 0; deferring removal (restored in pending)
14:24:46.130 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='58613cfba1708eae4f92fae654ed35f68a3af7463f840daf1d478422788f09e1'}]
14:24:46.131 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.131 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.132 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:46.137 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.138 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.148 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x510d706b, L:/127.0.0.1:36018 - R:/127.15.248.129:36421] using TOKEN/null
14:24:46.149 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [817bec26811de89160161deb46b14f143c670db8a186d4fd54191b342bff9918]
14:24:46.149 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:46.149 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:46.150 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:46.150 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 817bec26811de89160161deb46b14f143c670db8a186d4fd54191b342bff9918 finished by subtask 2; deferring removal (restored in pending)
14:24:46.150 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:46.171 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:46.178 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:46.192 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:46.192 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:46.192 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:46.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:46.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:46.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:46.193 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:46.193 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:46.193 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:46.193 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:46.193 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:46.193 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:46.193 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:46.207 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.207 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.216 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.217 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.220 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:46.222 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:46.222 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:46.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:46.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:46.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:46.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:46.222 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:46.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:46.222 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:46.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:46.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:46.223 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:46.224 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.224 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.228 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:46.229 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.229 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.234 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.234 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.236 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb11df006, L:/127.0.0.1:54502 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:46.238 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.239 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.244 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:46.244 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:46.245 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:46.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.245 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.245 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:46.245 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.245 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.245 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:46.246 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:46.246 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:46.253 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.258 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [08ccfc96655806b31b0c2f5b5136da63bb1196d0e1b7c20e2b80bfd98a6b33ab]
14:24:46.259 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:24:46.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:46.233847 16745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.248.131:42259, user_credentials={real_user=slave}} blocked reactor thread for 57981.9us
14:24:46.274 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.274 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.274 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.275 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.275 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.275 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.275 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.275 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.276 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.276 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.276 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.276 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.276 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.277 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.277 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.278 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [08ccfc96655806b31b0c2f5b5136da63bb1196d0e1b7c20e2b80bfd98a6b33ab]
14:24:46.279 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 08ccfc96655806b31b0c2f5b5136da63bb1196d0e1b7c20e2b80bfd98a6b33ab finished by subtask 3; deferring removal (restored in pending)
14:24:46.283 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:24:46.283 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:24:46.283 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:46.284 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.284 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.284 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.284 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.285 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.285 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.285 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.285 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.296 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:46.296 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.297 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.298 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:46.298 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:46.298 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:46.298 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:46.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.316 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.316 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.329 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.330 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.340 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.340 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.345 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.345 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.353 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.353 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:46.354 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.359 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.359 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.375 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:24:46.377 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:46.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.406 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.406 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.406 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:46.418 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.419 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.424 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.425 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.432 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.432 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.437 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.438 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.447 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.447 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.468 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:46.493 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:46.503 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:46.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.522 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.522 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.527 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.527 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.533 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.533 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.538 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.539 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.543 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.543 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.557 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.568 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5447a39a, L:/127.0.0.1:54506 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:46.574 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.574 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.575 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:46.575 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.575 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [18e713c972120db2000456d12e515d3be6445b68a5a32615ddc1db33701b0481]
14:24:46.597 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.597 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.597 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.598 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:24:46.600 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.601 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.611 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [18e713c972120db2000456d12e515d3be6445b68a5a32615ddc1db33701b0481]
14:24:46.611 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.611 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.611 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:24:46.611 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:24:46.612 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:46.613 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 18e713c972120db2000456d12e515d3be6445b68a5a32615ddc1db33701b0481 finished by subtask 1; deferring removal (restored in pending)
14:24:46.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:46.618 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 2c28d6d49adcc0d598680955c9f9304b (4910 bytes, checkpointDuration=577 ms, finalizationTime=0 ms).
14:24:46.619 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:24:46.619 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 18e713c972120db2000456d12e515d3be6445b68a5a32615ddc1db33701b0481 from pending
14:24:46.619 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 6c4edfaec1a49c0825409ce621d017f9174e3bea6bbc3406c6e8e731b9c3d1bf from pending
14:24:46.619 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 08ccfc96655806b31b0c2f5b5136da63bb1196d0e1b7c20e2b80bfd98a6b33ab from pending
14:24:46.620 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 817bec26811de89160161deb46b14f143c670db8a186d4fd54191b342bff9918 from pending
14:24:46.620 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split b97880c054474c0f4264af8d7d0c2d675d5b39d97df452ef721d4503f5f79f1a from pending
14:24:46.620 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 5 finished splits from enumerator state
14:24:46.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114286619 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:46.624 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=505, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@c958e15, flushNotification=Deferred@1881919279(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:24:46.624 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.624 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.624 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] connecting to peer
14:24:46.629 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.629 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.634 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.634 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.646 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.646 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.659 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:46.669 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:46.703 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.703 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.706 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.708 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.708 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.714 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.714 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.716 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7f66442f, L:/127.0.0.1:54518 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:46.719 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.719 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.730 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.731 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.731 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:24:46.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.740 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.740 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.742 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252112760832001) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.742 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [58613cfba1708eae4f92fae654ed35f68a3af7463f840daf1d478422788f09e1]
14:24:46.742 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [58613cfba1708eae4f92fae654ed35f68a3af7463f840daf1d478422788f09e1]
14:24:46.742 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:24:46.743 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:24:46.744 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 58613cfba1708eae4f92fae654ed35f68a3af7463f840daf1d478422788f09e1 finished by subtask 0; deferring removal (restored in pending)
14:24:46.744 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:46.745 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:46.752 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] Successfully connected to peer
14:24:46.799 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.799 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.806 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.806 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.811 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.811 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.817 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.817 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.821 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:46.822 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.823 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.829 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.829 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:46.839 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x32f17086, L:/127.0.0.1:47552 - R:/127.15.248.131:42259] using TOKEN/null
14:24:46.839 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:46.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:46.840 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:46.840 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:24:46.841 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:46.841 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:46.842 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:46.842 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.842 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.842 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.846 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.846 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.846 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.846 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:46.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:46.899 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:46.899 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:46.900 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:46.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.900 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.900 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:46.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:46.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:46.901 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:46.920 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.921 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:46.926 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.926 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:46.933 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.933 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:46.939 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.939 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:46.970 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 2c28d6d49adcc0d598680955c9f9304b (1619 bytes, checkpointDuration=351 ms, finalizationTime=0 ms).
14:24:46.972 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:24:46.972 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 58613cfba1708eae4f92fae654ed35f68a3af7463f840daf1d478422788f09e1 from pending
14:24:46.972 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 1 finished splits from enumerator state
14:24:46.990 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.990 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:46.996 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:46.996 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.000 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:47.001 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:47.001 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:47.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:47.001 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:47.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:47.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:47.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:47.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:47.002 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:47.002 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:47.002 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:47.003 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:47.030 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:47.030 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:47.030 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:47.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:47.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:47.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:47.031 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:47.031 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:47.031 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:47.032 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:47.032 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:47.032 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:47.032 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:47.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114287042 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:47.055 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.056 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:47.057 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 2c28d6d49adcc0d598680955c9f9304b (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:24:47.060 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:24:47.067 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.067 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:47.073 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.073 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:47.088 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.088 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:47.093 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.093 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:47.101 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.101 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.105 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:47.108 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:47.111 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:47.114 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:47.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:47.120 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:47.126 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:47.126 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:47.127 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:47.127 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.129 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.129 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.129 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.130 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.130 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.130 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.130 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:47.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:47.135 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:47.140 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:47.146 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 4268c7e5687744f0912da2bc035410d4
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:47.151 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:47.151 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:47.152 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.52.60:41453, [5ms] Sub RPC GetTableLocations: received response from server master-127.15.52.60:41453: OK, deferred=null)) after lookup
14:24:47.165 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:47.165 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:47.165 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:47.165 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.165 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.166 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:47.166 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:47.166 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.166 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.166 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:47.166 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:47.215 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=700268f26d6f48639ecc59e8eadbfc1a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.215 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 700268f26d6f48639ecc59e8eadbfc1a for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:47.221 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.221 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 17bc96540e05493cbecf58e57ab846f3 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:47.230 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.230 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet aa2197643da04c3c8583bdf6a4bd6b34 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:47.238 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.238 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet f3d59ba9291f4075b09130cbc06ca717 for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:47.239 [DEBUG - main] (Connection.java:748) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] connecting to peer
14:24:47.261 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] Successfully connected to peer
14:24:47.285 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.293 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x98200216, L:/127.0.0.1:40866 - R:/127.15.52.1:34821] using TOKEN/null
14:24:47.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.318 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.318 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet b0d33a35fb26473baaf15bd936d6b042 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:47.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 737c32be70c64db39b160c05047fc60d for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 368e034c1fc7426db93ff40d2701617d for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fd804315c8c748db8abc75cb8523f9eb for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet af2ca7a84f9947939e7634f5d21dc977 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1ee63373fea547498828c80dac4a046a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 36ddafe3aab54016a5fba6f0b7485fe1 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 48f7daa406e84cd4918f883176872ee3 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:47.329 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=368e034c1fc7426db93ff40d2701617d@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=fd804315c8c748db8abc75cb8523f9eb@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=af2ca7a84f9947939e7634f5d21dc977@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1ee63373fea547498828c80dac4a046a@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=36ddafe3aab54016a5fba6f0b7485fe1@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259),504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)[L],54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=48f7daa406e84cd4918f883176872ee3@[20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)[L],504d6bc3351843caab10c4c62664c443(127.15.248.129:36421),54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:47.329 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.248.188:46025, [3ms] Sub RPC GetTableLocations: received response from server master-127.15.248.188:46025: OK, deferred=null)) after lookup
14:24:47.342 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.342 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:47.347 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:47.349 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.350 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:47.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:47.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:47.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:47.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:47.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:47.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:47.354 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:47.358 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b9b4eb23da597dc244468e790cea79d03c110e49254d3e8d3082034a87a0dc5e'}]
14:24:47.360 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.361 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a6c4d4a223e19806c00207d10d7010980d8773381b14ae924efb8774ab27f9ff'}]
14:24:47.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='63a8f527a5171bdef65e98804e1c3d27a80202c76652954a8a0ee0b89e82c91f'}]
14:24:47.363 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6d8d67094d0960b96f7d1efa2e8876d222e7e431fbebe91ed9babcfa894c4dae'}]
14:24:47.364 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:24:47.364 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:47.365 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.365 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:47.366 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.367 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:24:47.367 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:47.367 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.368 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:24:47.368 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299998, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:47.369 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.369 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:24:47.370 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299998, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:47.370 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.371 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:47.371 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:47.371 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:47.372 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.372 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.372 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.372 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.372 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.373 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.373 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.373 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.373 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:47.379 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.382 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.382 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.384 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.384 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:47.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.390 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.390 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:47.393 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.400 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.403 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.403 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.406 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.411 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.412 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:47.412 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:47.412 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:47.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:47.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:47.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:47.413 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:47.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:47.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:47.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:47.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:47.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:47.414 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:47.414 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=700268f26d6f48639ecc59e8eadbfc1a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.414 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 700268f26d6f48639ecc59e8eadbfc1a for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:47.429 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.429 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 17bc96540e05493cbecf58e57ab846f3 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:47.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet aa2197643da04c3c8583bdf6a4bd6b34 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:47.446 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.446 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet f3d59ba9291f4075b09130cbc06ca717 for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:47.452 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.452 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet b0d33a35fb26473baaf15bd936d6b042 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:47.452 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.468 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.472 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.476 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:47.476 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:47.476 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:47.477 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.477 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.478 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.478 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.478 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:47.479 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.482 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.487 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.492 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.497 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0a843523, L:/127.0.0.1:54560 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.499 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.499 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 737c32be70c64db39b160c05047fc60d for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.521 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.530 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=368e034c1fc7426db93ff40d2701617d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.530 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 368e034c1fc7426db93ff40d2701617d for partition [0x00000000, 0x0000000080000032) with scanner id null
14:24:47.538 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fd804315c8c748db8abc75cb8523f9eb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.538 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet fd804315c8c748db8abc75cb8523f9eb for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
14:24:47.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114287541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:47.545 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=af2ca7a84f9947939e7634f5d21dc977, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.545 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet af2ca7a84f9947939e7634f5d21dc977 for partition [0x0000000080000096, 0x00000001) with scanner id null
14:24:47.552 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 2c28d6d49adcc0d598680955c9f9304b (4970 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:47.554 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:24:47.563 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1ee63373fea547498828c80dac4a046a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.563 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 1ee63373fea547498828c80dac4a046a for partition [0x00000001, 0x0000000180000032) with scanner id null
14:24:47.569 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfead63b7, L:/127.0.0.1:54544 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.580 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.580 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [6d8d67094d0960b96f7d1efa2e8876d222e7e431fbebe91ed9babcfa894c4dae]
14:24:47.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6d8d67094d0960b96f7d1efa2e8876d222e7e431fbebe91ed9babcfa894c4dae]
14:24:47.581 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:24:47.581 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:24:47.583 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.583 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6d8d67094d0960b96f7d1efa2e8876d222e7e431fbebe91ed9babcfa894c4dae finished by subtask 0; deferring removal (restored in pending)
14:24:47.583 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.584 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9e5a63a48a175990332dd9f922080bca23b95a69231f85b10acecfbcfadb0ec6'}]
14:24:47.585 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.585 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:24:47.586 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}]
14:24:47.593 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4c73a89, L:/127.0.0.1:54570 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.596 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36ddafe3aab54016a5fba6f0b7485fe1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.596 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 36ddafe3aab54016a5fba6f0b7485fe1 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
14:24:47.603 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48f7daa406e84cd4918f883176872ee3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.603 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 48f7daa406e84cd4918f883176872ee3 for partition [0x0000000180000096, 0x00000002) with scanner id null
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.188:46025(127.15.248.188:46025)] disconnecting while in state READY
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] disconnecting while in state READY
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] disconnecting while in state READY
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.190:44713(127.15.248.190:44713)] disconnecting while in state READY
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer 54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)] disconnecting while in state READY
14:24:47.603 [DEBUG - main] (Connection.java:575) [peer master-127.15.248.189:37707(127.15.248.189:37707)] disconnecting while in state READY
14:24:47.603 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:47.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:47.604 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:47.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:47.604 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:47.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:47.606 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] handling channelInactive
14:24:47.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] cleaning up while in state READY due to: connection closed
14:24:47.606 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.604 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)] handling channelInactive
14:24:47.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 54f09c579ac84282aeb07ff0971d1024(127.15.248.130:41989)] cleaning up while in state READY due to: connection closed
14:24:47.608 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.608 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
14:24:47.608 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:24:47.608 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
14:24:47.608 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:24:47.610 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbc96b024, L:/127.0.0.1:54532 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.610 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.629 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.629 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [63a8f527a5171bdef65e98804e1c3d27a80202c76652954a8a0ee0b89e82c91f]
14:24:47.629 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [63a8f527a5171bdef65e98804e1c3d27a80202c76652954a8a0ee0b89e82c91f]
14:24:47.630 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:24:47.630 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:24:47.631 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 63a8f527a5171bdef65e98804e1c3d27a80202c76652954a8a0ee0b89e82c91f finished by subtask 1; deferring removal (restored in pending)
14:24:47.631 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.632 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9c40f2dd5fdfaf6e8e06cdf69dce247ed691adb5f49982e0311d9e854092aa33'}]
14:24:47.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:47.633 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:24:47.634 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:47.635 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.641 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=700268f26d6f48639ecc59e8eadbfc1a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.641 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [b9b4eb23da597dc244468e790cea79d03c110e49254d3e8d3082034a87a0dc5e]
14:24:47.641 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b9b4eb23da597dc244468e790cea79d03c110e49254d3e8d3082034a87a0dc5e]
14:24:47.641 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:24:47.641 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:24:47.642 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.642 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.643 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b9b4eb23da597dc244468e790cea79d03c110e49254d3e8d3082034a87a0dc5e finished by subtask 2; deferring removal (restored in pending)
14:24:47.691 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:47.691 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:47.692 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:47.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.693 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.693 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.693 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.693 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.693 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.693 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.693 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.693 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:47.693 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:24:47.698 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] handling channelInactive
14:24:47.698 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] cleaning up while in state READY due to: connection closed
14:24:47.698 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-5
14:24:47.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:47.699381 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16699
14:24:47.705 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.707 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.714 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:47.728 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.748 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x286596cf, L:/127.0.0.1:54586 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.790 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.791 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9e5a63a48a175990332dd9f922080bca23b95a69231f85b10acecfbcfadb0ec6]
14:24:47.791 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9e5a63a48a175990332dd9f922080bca23b95a69231f85b10acecfbcfadb0ec6]
14:24:47.791 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:24:47.791 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:24:47.794 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9e5a63a48a175990332dd9f922080bca23b95a69231f85b10acecfbcfadb0ec6 finished by subtask 0; deferring removal (restored in pending)
14:24:47.794 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.798 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.800 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:24:47.800 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.800 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.815 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.816 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a6c4d4a223e19806c00207d10d7010980d8773381b14ae924efb8774ab27f9ff]
14:24:47.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a6c4d4a223e19806c00207d10d7010980d8773381b14ae924efb8774ab27f9ff]
14:24:47.816 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:24:47.817 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:24:47.817 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a6c4d4a223e19806c00207d10d7010980d8773381b14ae924efb8774ab27f9ff finished by subtask 3; deferring removal (restored in pending)
14:24:47.818 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.819 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.839 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:47.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.843 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:47.862 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:47.867 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa23306e0, L:/127.0.0.1:54600 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:47.871 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] handling channelInactive
14:24:47.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] cleaning up while in state READY due to: connection closed
14:24:47.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:47.872496 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16863
14:24:47.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:47.887 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252120940544001) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:47.888 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [9c40f2dd5fdfaf6e8e06cdf69dce247ed691adb5f49982e0311d9e854092aa33]
14:24:47.888 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9c40f2dd5fdfaf6e8e06cdf69dce247ed691adb5f49982e0311d9e854092aa33]
14:24:47.888 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:24:47.888 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:24:47.889 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9c40f2dd5fdfaf6e8e06cdf69dce247ed691adb5f49982e0311d9e854092aa33 finished by subtask 1; deferring removal (restored in pending)
14:24:47.890 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:47.891 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:47.936 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.936 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.936 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.936 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:24:47.951 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:47.951 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:47.951 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:47.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.952 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:47.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:47.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:47.953 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:47.953 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.953 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.953 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:24:47.957 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.957 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.957 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:24:47.959 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:47.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:47.959 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:47.960 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:24:47.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:47.991458 17108 connection.cc:582] client connection to 127.15.248.130:41989 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:47.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:47.991932 17108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:48.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:48.012638 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 17026
14:24:48.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114288041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:48.053 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 2c28d6d49adcc0d598680955c9f9304b (4970 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:24:48.055 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 6d8d67094d0960b96f7d1efa2e8876d222e7e431fbebe91ed9babcfa894c4dae from pending
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 9e5a63a48a175990332dd9f922080bca23b95a69231f85b10acecfbcfadb0ec6 from pending
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 63a8f527a5171bdef65e98804e1c3d27a80202c76652954a8a0ee0b89e82c91f from pending
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 9c40f2dd5fdfaf6e8e06cdf69dce247ed691adb5f49982e0311d9e854092aa33 from pending
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split b9b4eb23da597dc244468e790cea79d03c110e49254d3e8d3082034a87a0dc5e from pending
14:24:48.055 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split a6c4d4a223e19806c00207d10d7010980d8773381b14ae924efb8774ab27f9ff from pending
14:24:48.055 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 6 finished splits from enumerator state
14:24:48.141 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] handling channelInactive
14:24:48.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 20ea43f9145d41cb97a474d459e71881(127.15.248.131:42259)] cleaning up while in state READY due to: connection closed
14:24:48.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:48.166389 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16367
14:24:48.169 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:48.169 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:48.169 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:48.170 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.170 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.171 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:48.226 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:48.226 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:48.226 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:48.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.227 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.227 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.227 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:48.268 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:48.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:48.271 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:48.271 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:48.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:48.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:48.271 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.248.190:44713(127.15.248.190:44713)] handling channelInactive
14:24:48.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state READY due to: connection closed
14:24:48.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:48.272697 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16494
14:24:48.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:48.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:48.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:48.332 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:48.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.334 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.334 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.334 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.334 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:48.336 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:48.336 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:48.337 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:48.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:48.337 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:48.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:48.338 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.248.189:37707(127.15.248.189:37707)] handling channelInactive
14:24:48.338 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state READY due to: connection closed
14:24:48.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:48.339972 16354 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16570
14:24:48.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:48.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:48.433 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:48.433 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.248.188:46025(127.15.248.188:46025)] handling channelInactive
14:24:48.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state READY due to: connection closed
14:24:48.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:48.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:48.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:48.437 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.437 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.437 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.437 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.437 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.438 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.438 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.438 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.438 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:48.480 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:48.481 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:48.481 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:48.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:48.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:48.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:48.482 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:48.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114288541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:48.552 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 2c28d6d49adcc0d598680955c9f9304b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:48.555 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:24:48.649 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:48.649 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:48.650 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:48.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.650 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.650 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:48.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:48.651 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.651 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:48.651 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:48.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:48.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:48.883 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114289041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:49.049 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 2c28d6d49adcc0d598680955c9f9304b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:49.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:24:49.140 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:49.141 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:49.141 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:49.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.142 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:49.186 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:49.186 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:49.186 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:49.187 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.187 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.188 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.188 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:49.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.342 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:49.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.349 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:49.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:49.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:49.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:49.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:49.350 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:49.350 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:49.354 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e09e7f25eccc832a245a6515b9683fa1fe4131239beb41ef27bdba9d40dd9f90'}]
14:24:49.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.356 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='65c6ec6df84c1f6333fd69c872ee475517607677f521271d3152fef4ae616d49'}]
14:24:49.357 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.357 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f7743a645518aab703aee3d9616b3e5c601109d2b9c944fb9a6e53a6ae8b1f0e'}]
14:24:49.358 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5b5f4c31e89d3ea974e766605c6493e8888336c69f0758f8521fff72bddb02f7'}]
14:24:49.360 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.360 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:24:49.360 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:49.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:24:49.361 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:49.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:24:49.362 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299998, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:49.362 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:24:49.362 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299998, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:49.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.383 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.390 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.402 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.402 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.406 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.412 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.421 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.422 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.442 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.444 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.453 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.456 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.461 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.464 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.470 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb9fd3ee5, L:/127.0.0.1:56628 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.472 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2704d5e6, L:/127.0.0.1:56604 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.481 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.486 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.487 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb9350db2, L:/127.0.0.1:56602 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.487 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.488 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [65c6ec6df84c1f6333fd69c872ee475517607677f521271d3152fef4ae616d49]
14:24:49.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [65c6ec6df84c1f6333fd69c872ee475517607677f521271d3152fef4ae616d49]
14:24:49.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:24:49.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:24:49.489 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 65c6ec6df84c1f6333fd69c872ee475517607677f521271d3152fef4ae616d49 finished by subtask 0; deferring removal (restored in pending)
14:24:49.491 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.491 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f7cef6c2642ddd03050518ee6bd2214fce0041bf5dc84dd311c905ce0674e0e5'}]
14:24:49.492 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.494 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
14:24:49.494 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x08250571, L:/127.0.0.1:56612 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.494 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299998, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}]
14:24:49.495 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.495 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [5b5f4c31e89d3ea974e766605c6493e8888336c69f0758f8521fff72bddb02f7]
14:24:49.495 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5b5f4c31e89d3ea974e766605c6493e8888336c69f0758f8521fff72bddb02f7]
14:24:49.495 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:24:49.495 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:24:49.496 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.496 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5b5f4c31e89d3ea974e766605c6493e8888336c69f0758f8521fff72bddb02f7 finished by subtask 1; deferring removal (restored in pending)
14:24:49.497 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fdf1691a06acbc308f7f8a564c905e76ec44312a2019020064585d87332a1fbe'}]
14:24:49.498 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.498 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:49.499 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
14:24:49.499 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:49.500 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.501 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.511 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:49.533 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:49.533 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:49.533 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:49.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:49.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:49.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:49.535 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:49.535 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:49.535 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:49.535 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.535 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:49.536 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:49.536 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:49.536 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.536 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:49.536 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:24:49.544 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114289541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:49.554 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 2c28d6d49adcc0d598680955c9f9304b (4970 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:24:49.555 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:24:49.555 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 65c6ec6df84c1f6333fd69c872ee475517607677f521271d3152fef4ae616d49 from pending
14:24:49.556 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 5b5f4c31e89d3ea974e766605c6493e8888336c69f0758f8521fff72bddb02f7 from pending
14:24:49.556 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 2 finished splits from enumerator state
14:24:49.569 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.576 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.577 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:49.577 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:49.577 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:49.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:49.579 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.579 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.579 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.579 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.579 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.579 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.579 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:49.590 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.594 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x305f644e, L:/127.0.0.1:56630 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.600 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:49.603 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:49.612 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.612 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [fdf1691a06acbc308f7f8a564c905e76ec44312a2019020064585d87332a1fbe]
14:24:49.612 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fdf1691a06acbc308f7f8a564c905e76ec44312a2019020064585d87332a1fbe]
14:24:49.613 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
14:24:49.613 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
14:24:49.614 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fdf1691a06acbc308f7f8a564c905e76ec44312a2019020064585d87332a1fbe finished by subtask 1; deferring removal (restored in pending)
14:24:49.614 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.614 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:49.615 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.618 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.618 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.619 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:24:49.622 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x58c80480, L:/127.0.0.1:56644 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:49.638 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.639 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [f7743a645518aab703aee3d9616b3e5c601109d2b9c944fb9a6e53a6ae8b1f0e]
14:24:49.639 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f7743a645518aab703aee3d9616b3e5c601109d2b9c944fb9a6e53a6ae8b1f0e]
14:24:49.639 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:24:49.639 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:24:49.641 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.641 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.642 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f7743a645518aab703aee3d9616b3e5c601109d2b9c944fb9a6e53a6ae8b1f0e finished by subtask 3; deferring removal (restored in pending)
14:24:49.646 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:49.646 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:49.647 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:49.647 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.647 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:49.647 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.648 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:49.655 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.656 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [f7cef6c2642ddd03050518ee6bd2214fce0041bf5dc84dd311c905ce0674e0e5]
14:24:49.656 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f7cef6c2642ddd03050518ee6bd2214fce0041bf5dc84dd311c905ce0674e0e5]
14:24:49.656 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
14:24:49.656 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
14:24:49.656 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.657 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f7cef6c2642ddd03050518ee6bd2214fce0041bf5dc84dd311c905ce0674e0e5 finished by subtask 0; deferring removal (restored in pending)
14:24:49.657 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.684 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.684 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.684 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
14:24:49.717 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252129128448001) for scanner KuduScanner(table=replication_test_table, tablet=700268f26d6f48639ecc59e8eadbfc1a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:49.718 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [e09e7f25eccc832a245a6515b9683fa1fe4131239beb41ef27bdba9d40dd9f90]
14:24:49.718 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e09e7f25eccc832a245a6515b9683fa1fe4131239beb41ef27bdba9d40dd9f90]
14:24:49.718 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:24:49.718 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:24:49.719 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e09e7f25eccc832a245a6515b9683fa1fe4131239beb41ef27bdba9d40dd9f90 finished by subtask 2; deferring removal (restored in pending)
14:24:49.720 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:49.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:49.747 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.747 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.748 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
14:24:49.766 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:49.766 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:49.766 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:49.770 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.770 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.770 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.772 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:49.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.831 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.831 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.831 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:24:49.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.850 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:49.850 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:49.850 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:24:49.850 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:24:49.884 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:49.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:49.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:49.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:49.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:49.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:49.997 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.997 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.997 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:49.997 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:50.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114290041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:50.052 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 2c28d6d49adcc0d598680955c9f9304b (3632 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:50.056 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:24:50.056 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split f7743a645518aab703aee3d9616b3e5c601109d2b9c944fb9a6e53a6ae8b1f0e from pending
14:24:50.056 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split f7cef6c2642ddd03050518ee6bd2214fce0041bf5dc84dd311c905ce0674e0e5 from pending
14:24:50.056 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split fdf1691a06acbc308f7f8a564c905e76ec44312a2019020064585d87332a1fbe from pending
14:24:50.056 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split e09e7f25eccc832a245a6515b9683fa1fe4131239beb41ef27bdba9d40dd9f90 from pending
14:24:50.056 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 4 finished splits from enumerator state
14:24:50.061 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:50.061 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:50.061 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:50.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.062 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.062 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.062 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.063 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.063 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.063 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.063 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:50.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:50.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:50.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:50.163 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.163 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.163 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.163 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.163 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:50.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:50.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:50.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:50.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:50Z chronyd exiting
14:24:50.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:50.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:50.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:50.492 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:50.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:50.492 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:50.492 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:50.492 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:50.492 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:50.492 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:50.492 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:50.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:50.492 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:50.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114290541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:50.566 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 2c28d6d49adcc0d598680955c9f9304b (964 bytes, checkpointDuration=25 ms, finalizationTime=0 ms).
14:24:50.570 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:24:50.678 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:50.678 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:50.678 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:50.678 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:50.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:50.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:50.852 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:50.852 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:50.852 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:50.853 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.853 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.853 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.854 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:50.854 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [13ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [284ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [284ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [581ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [963ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [963ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1903ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3682ms] refreshing cache from master, [3682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3685ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4381ms] refreshing cache from master, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4382ms] too many traces: truncated at 100 traces, deferred=Deferred@1972380822(state=PENDING, result=null, callback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240), errback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240)))
14:24:50.855 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:50.855 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [13ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [284ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [284ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [581ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [963ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [963ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1903ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3682ms] refreshing cache from master, [3682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3685ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4381ms] refreshing cache from master, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4382ms] too many traces: truncated at 100 traces, deferred=Deferred@1972380822(state=PENDING, result=null, callback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240), errback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:50.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:24:50.858 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:24:50.860 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [13ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [73ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [284ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [284ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [581ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [963ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [963ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1903ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3682ms] refreshing cache from master, [3682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3684ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3685ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4381ms] refreshing cache from master, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4382ms] too many traces: truncated at 100 traces, deferred=Deferred@1972380822(state=PENDING, result=null, callback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240), errback=(continuation of Deferred@2007742328 after retry RPC after error@2060980873) -> (continuation of Deferred@1161627019 after retry RPC after error@838679854) -> (continuation of Deferred@466045982 after retry RPC after error@565266869) -> (continuation of Deferred@210571605 after retry RPC after error@1421957543) -> (continuation of Deferred@1975998621 after retry RPC after error@1578126193) -> (continuation of Deferred@989068895 after retry RPC after error@1679918279) -> (continuation of Deferred@728578926 after retry RPC after error@2012919473) -> (continuation of Deferred@1390325527 after retry RPC after error@984682039) -> (continuation of Deferred@2017846340 after retry RPC after error@1512606403) -> (continuation of Deferred@2108235910 after retry RPC after error@1331382706) -> (continuation of Deferred@418116569 after retry RPC after error@101391509) -> (continuation of Deferred@840085954 after retry RPC after error@655456491) -> (continuation of Deferred@1612919531 after retry RPC after error@1041393102) -> (continuation of Deferred@422137711 after retry RPC after error@894679681) -> (continuation of Deferred@1285452458 after retry RPC after error@1636778722) -> (continuation of Deferred@848182155 after retry RPC after error@438376681) -> (continuation of Deferred@622141989 after retry RPC after error@1041693751) -> (continuation of Deferred@2106051101 after retry RPC after error@1878221588) -> (continuation of Deferred@1677418693 after retry RPC after error@1787158473) -> (continuation of Deferred@697382822 after retry RPC after error@1569593923) -> (continuation of Deferred@1707848831 after retry RPC after error@561271960) -> (continuation of Deferred@33057559 after retry RPC after error@738801001) -> (continuation of Deferred@341378267 after retry RPC after error@394941020) -> (continuation of Deferred@1441280873 after retry RPC after error@816834240)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:50.861 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
14:24:50.861 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:24:50.861 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:24:50.861 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:50.869 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:50.869 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:50.869 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:50.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:50.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:50.870 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.870 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.870 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:50.870 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:50.871 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=28390), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [19ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [47ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [52ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [56ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [91ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [94ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [97ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [203ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [744ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6341ms] refreshing cache from master, [6341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6342ms] too many traces: truncated at 100 traces, deferred=Deferred@1767883225(state=PENDING, result=null, callback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560), errback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560)))
14:24:50.871 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:50.872 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=28390), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [19ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [47ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [52ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [56ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [91ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [94ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [97ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [203ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [744ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6341ms] refreshing cache from master, [6341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6342ms] too many traces: truncated at 100 traces, deferred=Deferred@1767883225(state=PENDING, result=null, callback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560), errback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:50.872 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:24:50.874 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:24:50.876 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=28390), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [19ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [47ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [52ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [56ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [91ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [94ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [97ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [125ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [126ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [203ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [203ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [744ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6341ms] refreshing cache from master, [6341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6342ms] too many traces: truncated at 100 traces, deferred=Deferred@1767883225(state=PENDING, result=null, callback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560), errback=(continuation of Deferred@1102783067 after retry RPC after error@1137870424) -> (continuation of Deferred@206829236 after retry RPC after error@462794734) -> (continuation of Deferred@52752189 after retry RPC after error@1418942791) -> (continuation of Deferred@1206317879 after retry RPC after error@1899679482) -> (continuation of Deferred@1438882535 after retry RPC after error@466925689) -> (continuation of Deferred@1809555327 after retry RPC after error@1278333408) -> (continuation of Deferred@99380771 after retry RPC after error@1002772887) -> (continuation of Deferred@215108087 after retry RPC after error@1320040284) -> (continuation of Deferred@685102556 after retry RPC after error@995059952) -> (continuation of Deferred@634127263 after retry RPC after error@451396781) -> (continuation of Deferred@479889688 after retry RPC after error@1557293715) -> (continuation of Deferred@424102509 after retry RPC after error@1033971524) -> (continuation of Deferred@1975237537 after retry RPC after error@988991863) -> (continuation of Deferred@432398438 after retry RPC after error@761954077) -> (continuation of Deferred@86290338 after retry RPC after error@703708952) -> (continuation of Deferred@520207504 after retry RPC after error@1642965754) -> (continuation of Deferred@1100239066 after retry RPC after error@1706638991) -> (continuation of Deferred@2010053524 after retry RPC after error@2079864301) -> (continuation of Deferred@411678920 after retry RPC after error@887660560)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:50.877 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:24:50.878 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:50.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
14:24:50.902 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:50.902 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:50.902 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:50.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.903 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.903 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:50.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.903 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.903 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:50.903 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:50.903 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:50.940 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:50.941 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:50.941 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:50.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:50.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:50.942 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.942 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.942 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:50.942 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:51.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114291041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:51.054 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 2c28d6d49adcc0d598680955c9f9304b (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:24:51.056 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:24:51.225 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:51.225 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:51.226 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:51.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.227 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.227 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.227 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:51.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:51.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:51.343 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 02f5f67d99ce47d49e73c1f762ed4239
14:24:51.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 700268f26d6f48639ecc59e8eadbfc1a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
14:24:51.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 17bc96540e05493cbecf58e57ab846f3 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
14:24:51.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aa2197643da04c3c8583bdf6a4bd6b34 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
14:24:51.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f3d59ba9291f4075b09130cbc06ca717 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
14:24:51.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b0d33a35fb26473baaf15bd936d6b042 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
14:24:51.354 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 737c32be70c64db39b160c05047fc60d for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
14:24:51.354 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
14:24:51.364 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='15e60f4f1a4df0375db4b9bc13fee877c03eb51ca05420535c157a6db5356f7c'}]
14:24:51.365 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.366 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6d0dc5b4e7a1949460e09c48246d9dbab82c3d95b9dc720ca90473f0e347bf36'}]
14:24:51.367 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d04b529c534a9293ccecb9af49b28ca6c07036e124c8ee4b15c38e987fc3cf88'}]
14:24:51.368 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.368 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:24:51.369 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=17bc96540e05493cbecf58e57ab846f3@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:51.369 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
14:24:51.370 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299998, tablet=aa2197643da04c3c8583bdf6a4bd6b34@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:51.370 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='47897defee22484c1a65f74cfb6bc1a5267eb582aed45a0653cb25bee4f5d5af'}]
14:24:51.371 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.372 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:24:51.372 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299998, tablet=f3d59ba9291f4075b09130cbc06ca717@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:51.377 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
14:24:51.378 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=700268f26d6f48639ecc59e8eadbfc1a@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)[L],867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:51.387 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.389 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:51.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:51.391 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:51.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.392 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.392 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.393 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:51.406 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.426 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.430 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.447 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.470 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.471 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfe1d3162, L:/127.0.0.1:56656 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.474 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.509 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252137320448001) for scanner KuduScanner(table=replication_test_table, tablet=17bc96540e05493cbecf58e57ab846f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:51.510 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [6d0dc5b4e7a1949460e09c48246d9dbab82c3d95b9dc720ca90473f0e347bf36]
14:24:51.510 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6d0dc5b4e7a1949460e09c48246d9dbab82c3d95b9dc720ca90473f0e347bf36]
14:24:51.510 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:24:51.510 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:24:51.511 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6d0dc5b4e7a1949460e09c48246d9dbab82c3d95b9dc720ca90473f0e347bf36 finished by subtask 3; deferring removal (restored in pending)
14:24:51.512 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.512 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bda2070c7c591904549febcd0210bf1a7c5630e929ba01eccbbb4e77c66a491a'}]
14:24:51.514 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.516 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.519 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.534 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114291542 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:51.548 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.548 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.557 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3fbcabd1, L:/127.0.0.1:56664 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.580 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:24:51.580 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 2c28d6d49adcc0d598680955c9f9304b (4970 bytes, checkpointDuration=38 ms, finalizationTime=0 ms).
14:24:51.583 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:24:51.583 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 6d0dc5b4e7a1949460e09c48246d9dbab82c3d95b9dc720ca90473f0e347bf36 from pending
14:24:51.583 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 1 finished splits from enumerator state
14:24:51.584 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299998, tablet=b0d33a35fb26473baaf15bd936d6b042@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157),e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)[L]]}]
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.60:41453(127.15.52.60:41453)] disconnecting while in state READY
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.61:40475(127.15.52.61:40475)] disconnecting while in state READY
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] disconnecting while in state READY
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] disconnecting while in state READY
14:24:51.585 [DEBUG - main] (Connection.java:575) [peer master-127.15.52.62:42455(127.15.52.62:42455)] disconnecting while in state READY
14:24:51.585 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.52.61:40475(127.15.52.61:40475)] handling channelInactive
14:24:51.585 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.52.60:41453(127.15.52.60:41453)] handling channelInactive
14:24:51.586 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state READY due to: connection closed
14:24:51.586 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.52.62:42455(127.15.52.62:42455)] handling channelInactive
14:24:51.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state READY due to: connection closed
14:24:51.585 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] handling channelInactive
14:24:51.586 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state READY due to: connection closed
14:24:51.585 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] handling channelInactive
14:24:51.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] cleaning up while in state READY due to: connection closed
14:24:51.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] cleaning up while in state READY due to: connection closed
14:24:51.590 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
14:24:51.590 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.590 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:24:51.590 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:24:51.591 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
14:24:51.596 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252137320448001) for scanner KuduScanner(table=replication_test_table, tablet=aa2197643da04c3c8583bdf6a4bd6b34, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:51.596 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [d04b529c534a9293ccecb9af49b28ca6c07036e124c8ee4b15c38e987fc3cf88]
14:24:51.596 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d04b529c534a9293ccecb9af49b28ca6c07036e124c8ee4b15c38e987fc3cf88]
14:24:51.596 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
14:24:51.596 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
14:24:51.597 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d04b529c534a9293ccecb9af49b28ca6c07036e124c8ee4b15c38e987fc3cf88 finished by subtask 0; deferring removal (restored in pending)
14:24:51.598 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.598 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='94ec36b394d4159dfa1eb7729b50c7bdd6c2a3438d42a5fd01b377eb35aa9ed0'}]
14:24:51.599 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:51.600 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 7
14:24:51.601 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299998, tablet=737c32be70c64db39b160c05047fc60d@[03dc834ad6514e3387738f0060b29612(127.15.52.1:34821),867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)[L],e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)]}]
14:24:51.603 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.604 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.612 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd8142b18, L:/127.0.0.1:56680 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.615 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.622 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdc7713db, L:/127.0.0.1:56686 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.626 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.626 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.627 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:24:51.628 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252137320448001) for scanner KuduScanner(table=replication_test_table, tablet=f3d59ba9291f4075b09130cbc06ca717, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:51.628 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [47897defee22484c1a65f74cfb6bc1a5267eb582aed45a0653cb25bee4f5d5af]
14:24:51.629 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [47897defee22484c1a65f74cfb6bc1a5267eb582aed45a0653cb25bee4f5d5af]
14:24:51.629 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:24:51.629 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:24:51.630 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 47897defee22484c1a65f74cfb6bc1a5267eb582aed45a0653cb25bee4f5d5af finished by subtask 2; deferring removal (restored in pending)
14:24:51.630 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.636 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.669 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.686 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] connecting to peer
14:24:51.701 [DEBUG - kudu-nio-4] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.701 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
14:24:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:51.702670 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 15904
14:24:51.719 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.723 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.752 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.760 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa49f3952, L:/127.0.0.1:56690 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.765 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:51.766 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:51.766 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:51.766 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.766 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.767 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:51.773 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252137320448001) for scanner KuduScanner(table=replication_test_table, tablet=737c32be70c64db39b160c05047fc60d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:51.773 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [94ec36b394d4159dfa1eb7729b50c7bdd6c2a3438d42a5fd01b377eb35aa9ed0]
14:24:51.773 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [94ec36b394d4159dfa1eb7729b50c7bdd6c2a3438d42a5fd01b377eb35aa9ed0]
14:24:51.778 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 94ec36b394d4159dfa1eb7729b50c7bdd6c2a3438d42a5fd01b377eb35aa9ed0 finished by subtask 0; deferring removal (restored in pending)
14:24:51.778 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 7 because it is idle.
14:24:51.778 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 7
14:24:51.778 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.784 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.806 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.807 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.807 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:24:51.808 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] Successfully connected to peer
14:24:51.810 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:51.816689 16092 connection.cc:582] client connection to 127.15.52.1:34821 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:51.817186 16092 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:51.820 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.3
14:24:51.826 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.826 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.826 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
14:24:51.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:51.825016 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16066
14:24:51.830 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:51.834 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf3dbc199, L:/127.0.0.1:56698 - R:/127.15.52.3:41829] using SASL/PLAIN
14:24:51.841 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:51.841 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:51.841 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:51.842 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.842 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.842 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:51.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:51.842 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.842 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.842 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:51.843 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.843 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.843 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:51.843 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:51.844 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.844 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.844 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 7 exited.
14:24:51.850 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252137320448001) for scanner KuduScanner(table=replication_test_table, tablet=b0d33a35fb26473baaf15bd936d6b042, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:24:51.850 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [bda2070c7c591904549febcd0210bf1a7c5630e929ba01eccbbb4e77c66a491a]
14:24:51.851 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bda2070c7c591904549febcd0210bf1a7c5630e929ba01eccbbb4e77c66a491a]
14:24:51.851 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:24:51.851 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:24:51.852 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bda2070c7c591904549febcd0210bf1a7c5630e929ba01eccbbb4e77c66a491a finished by subtask 3; deferring removal (restored in pending)
14:24:51.852 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state READY
14:24:51.853 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:51.858 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.858 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:24:51.859 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:24:51.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:51.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:51.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:51.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:51.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.865 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:51.865 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:51.865 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:51.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:51.885823 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 16214
14:24:51.929 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] handling channelInactive
14:24:51.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] cleaning up while in state READY due to: connection closed
14:24:51.930 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e4dbc1022b094e258f077442852021f9(127.15.52.3:41829) for tablet 700268f26d6f48639ecc59e8eadbfc1a: connection closed
14:24:51.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:51.930702 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 15580
14:24:51.950 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] connecting to peer
14:24:51.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157): Connection refused: /127.15.52.2:43157
14:24:51.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] cleaning up while in state CONNECTING due to: Failed to connect to peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157): Connection refused: /127.15.52.2:43157
14:24:51.951 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157) for tablet 700268f26d6f48639ecc59e8eadbfc1a: Failed to connect to peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157): Connection refused: /127.15.52.2:43157
14:24:51.963 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.52.62:42455(127.15.52.62:42455)] handling channelInactive
14:24:51.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state READY due to: connection closed
14:24:51.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:51.963748 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 15704
14:24:51.970 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] connecting to peer
14:24:51.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821): Connection refused: /127.15.52.1:34821
14:24:51.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] cleaning up while in state CONNECTING due to: Failed to connect to peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821): Connection refused: /127.15.52.1:34821
14:24:51.971 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821) for tablet 700268f26d6f48639ecc59e8eadbfc1a: Failed to connect to peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821): Connection refused: /127.15.52.1:34821
14:24:51.990 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:51.990 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:51.991 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.15.52.61:40475(127.15.52.61:40475)] Successfully connected to peer
14:24:51.991 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:51.991 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.15.52.60:41453(127.15.52.60:41453)] Successfully connected to peer
14:24:51.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:51.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:51.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:51.994 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.52.60
14:24:51.999 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.52.61:40475(127.15.52.61:40475)] handling channelInactive
14:24:51.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state READY due to: connection closed
14:24:52.000 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state NEGOTIATING due to: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475]
14:24:52.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475]
14:24:52.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:52.000118 15808 connection.cc:582] client connection to 127.15.52.61:40475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:52.000 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.15.52.61:40475(127.15.52.61:40475)] handling channelInactive
14:24:52.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:52.000679 15808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:24:52.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:52.001739 15568 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 15779
14:24:52.004 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:24:52.034 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.52.60:41453(127.15.52.60:41453)] handling channelInactive
14:24:52.034 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state READY due to: connection closed
14:24:52.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state NEGOTIATING due to: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453]
14:24:52.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453]
14:24:52.035 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.036 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.15.52.60:41453(127.15.52.60:41453)] handling channelInactive
14:24:52.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114292041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:52.049 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.050 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 2c28d6d49adcc0d598680955c9f9304b (4297 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:24:52.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:24:52.051 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 94ec36b394d4159dfa1eb7729b50c7bdd6c2a3438d42a5fd01b377eb35aa9ed0 from pending
14:24:52.051 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split d04b529c534a9293ccecb9af49b28ca6c07036e124c8ee4b15c38e987fc3cf88 from pending
14:24:52.051 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split bda2070c7c591904549febcd0210bf1a7c5630e929ba01eccbbb4e77c66a491a from pending
14:24:52.051 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 47897defee22484c1a65f74cfb6bc1a5267eb582aed45a0653cb25bee4f5d5af from pending
14:24:52.051 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 13 complete: removed 4 finished splits from enumerator state
14:24:52.051 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.052 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.052 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.052 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.052 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.052 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.069 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.069 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.069 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.069 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.069 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.070 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.070 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.070 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.070 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.070 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.070 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.070 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.089 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:52.089 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:52.090 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:52.090 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.090 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.090 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.090 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.091 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:52.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.091 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.105 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.105 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29592), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [66ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [67ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [116ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [117ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [117ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [308ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [308ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [423ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2163ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3680ms] refreshing cache from master, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3682ms] too many traces: truncated at 100 traces, deferred=Deferred@112700712(state=PENDING, result=null, callback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439), errback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439)))
14:24:52.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.105 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.106 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:52.105 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.106 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.106 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29592), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [66ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [67ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [116ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [117ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [117ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [308ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [308ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [423ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2163ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3680ms] refreshing cache from master, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3682ms] too many traces: truncated at 100 traces, deferred=Deferred@112700712(state=PENDING, result=null, callback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439), errback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.107 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:24:52.109 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:24:52.111 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29592), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [66ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [67ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [116ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [117ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [117ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [140ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [308ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [308ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [423ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [423ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [741ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [741ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2163ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3680ms] refreshing cache from master, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3682ms] too many traces: truncated at 100 traces, deferred=Deferred@112700712(state=PENDING, result=null, callback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439), errback=(continuation of Deferred@1317758139 after retry RPC after error@1436541835) -> (continuation of Deferred@1886547733 after retry RPC after error@1268208350) -> (continuation of Deferred@1579960747 after retry RPC after error@1954904670) -> (continuation of Deferred@393001244 after retry RPC after error@1721501837) -> (continuation of Deferred@1522627812 after retry RPC after error@97100392) -> (continuation of Deferred@2006933396 after retry RPC after error@1908537738) -> (continuation of Deferred@553043202 after retry RPC after error@1751447958) -> (continuation of Deferred@1695181041 after retry RPC after error@460963955) -> (continuation of Deferred@221366475 after retry RPC after error@1121335474) -> (continuation of Deferred@1957531129 after retry RPC after error@553824583) -> (continuation of Deferred@578179644 after retry RPC after error@1360457064) -> (continuation of Deferred@1229742326 after retry RPC after error@2112911377) -> (continuation of Deferred@1837576737 after retry RPC after error@186445652) -> (continuation of Deferred@570254609 after retry RPC after error@1605607887) -> (continuation of Deferred@200377890 after retry RPC after error@1744547399) -> (continuation of Deferred@769956420 after retry RPC after error@1872489454) -> (continuation of Deferred@1759293609 after retry RPC after error@1391440483) -> (continuation of Deferred@1531983040 after retry RPC after error@1797550303) -> (continuation of Deferred@1718672618 after retry RPC after error@1227032301) -> (continuation of Deferred@328191293 after retry RPC after error@1533404443) -> (continuation of Deferred@991098129 after retry RPC after error@1784125680) -> (continuation of Deferred@131876514 after retry RPC after error@1944397439)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.112 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:52.113 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:24:52.113 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
14:24:52.130 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.130 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.130 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.130 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.131 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.131 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.150 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.150 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.150 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.150 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.150 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.150 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.150 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.150 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.169 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.169 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.169 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.170 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.170 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.170 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.170 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.170 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.170 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.173 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:52.173 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:52.173 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:52.173 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.173 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.173 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.173 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:52.173 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:52.173 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.173 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.173 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:52.173 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:52.174 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29678), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [31ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [84ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [105ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [105ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [761ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6202ms] too many traces: truncated at 100 traces, deferred=Deferred@1671186567(state=PENDING, result=null, callback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273), errback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273)))
14:24:52.175 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:24:52.175 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29678), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [31ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [84ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [105ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [105ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [761ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6202ms] too many traces: truncated at 100 traces, deferred=Deferred@1671186567(state=PENDING, result=null, callback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273), errback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.176 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:24:52.178 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:24:52.180 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29678), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [31ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [84ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [105ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [105ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [761ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2323ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6202ms] too many traces: truncated at 100 traces, deferred=Deferred@1671186567(state=PENDING, result=null, callback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273), errback=(continuation of Deferred@1109831693 after retry RPC after error@1832428718) -> (continuation of Deferred@138627188 after retry RPC after error@152760715) -> (continuation of Deferred@2118880893 after retry RPC after error@1459509454) -> (continuation of Deferred@1147976333 after retry RPC after error@438607138) -> (continuation of Deferred@952025213 after retry RPC after error@472041356) -> (continuation of Deferred@1027321431 after retry RPC after error@63502687) -> (continuation of Deferred@1295744115 after retry RPC after error@1194319103) -> (continuation of Deferred@654744411 after retry RPC after error@1673563365) -> (continuation of Deferred@1963899914 after retry RPC after error@1283415664) -> (continuation of Deferred@1597036775 after retry RPC after error@955306048) -> (continuation of Deferred@941544888 after retry RPC after error@245661717) -> (continuation of Deferred@1468700358 after retry RPC after error@1766207143) -> (continuation of Deferred@658212130 after retry RPC after error@229973496) -> (continuation of Deferred@235574830 after retry RPC after error@1449243230) -> (continuation of Deferred@755515173 after retry RPC after error@142065057) -> (continuation of Deferred@1385619815 after retry RPC after error@155081257) -> (continuation of Deferred@1705229628 after retry RPC after error@1351392924) -> (continuation of Deferred@905232435 after retry RPC after error@1323318198) -> (continuation of Deferred@919745803 after retry RPC after error@35530035) -> (continuation of Deferred@293111835 after retry RPC after error@1586113545) -> (continuation of Deferred@2044145854 after retry RPC after error@169063690) -> (continuation of Deferred@1602145283 after retry RPC after error@1352358273)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.181 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:24:52.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
14:24:52.181 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:24:52.300 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.301 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.301 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.301 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.302 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.302 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.302 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29821), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [19ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [5460ms] refreshing cache from master, [5460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1625818248(state=PENDING, result=null, callback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319), errback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319)))
14:24:52.303 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.303 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.303 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.303 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29821), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [19ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [5460ms] refreshing cache from master, [5460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1625818248(state=PENDING, result=null, callback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319), errback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29821), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [19ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [5460ms] refreshing cache from master, [5460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1625818248(state=PENDING, result=null, callback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319), errback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.304 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.304 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.304 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.304 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:52.309 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.310 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.310 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.309 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29821), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [19ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [5460ms] refreshing cache from master, [5460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1625818248(state=PENDING, result=null, callback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319), errback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29821), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [19ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1762ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [5460ms] refreshing cache from master, [5460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1625818248(state=PENDING, result=null, callback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319), errback=(continuation of Deferred@774610823 after retry RPC after error@136041509) -> (continuation of Deferred@922639133 after retry RPC after error@370332942) -> (continuation of Deferred@1689757676 after retry RPC after error@844885411) -> (continuation of Deferred@1991867974 after retry RPC after error@1988329274) -> (continuation of Deferred@802307777 after retry RPC after error@1107945581) -> (continuation of Deferred@2139088164 after retry RPC after error@308821854) -> (continuation of Deferred@745680868 after retry RPC after error@557179015) -> (continuation of Deferred@568555328 after retry RPC after error@1914846957) -> (continuation of Deferred@1334977090 after retry RPC after error@1093518063) -> (continuation of Deferred@2077160701 after retry RPC after error@418936895) -> (continuation of Deferred@1185339728 after retry RPC after error@1764970961) -> (continuation of Deferred@1700149526 after retry RPC after error@1043635203) -> (continuation of Deferred@1311293132 after retry RPC after error@1038533377) -> (continuation of Deferred@1764541218 after retry RPC after error@1944227456) -> (continuation of Deferred@2025296110 after retry RPC after error@1942137394) -> (continuation of Deferred@2088260283 after retry RPC after error@453592378) -> (continuation of Deferred@1610450517 after retry RPC after error@965223586) -> (continuation of Deferred@131814562 after retry RPC after error@1445650934) -> (continuation of Deferred@1700141640 after retry RPC after error@486772596) -> (continuation of Deferred@1084270130 after retry RPC after error@1090837121) -> (continuation of Deferred@341122227 after retry RPC after error@363612514) -> (continuation of Deferred@1350106323 after retry RPC after error@927982735) -> (continuation of Deferred@188995153 after retry RPC after error@2085845250) -> (continuation of Deferred@1809484863 after retry RPC after error@603551319)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:24:52.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.310 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:24:52.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.310 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.311 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.311 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.311 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.320 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.320 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.321 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.321 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.321 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.342 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:52.360 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.361 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.361 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.361 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.361 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.361 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.362 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.380 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.381 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.381 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.381 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.381 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.381 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.381 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.381 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.382 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.400 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.401 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.401 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.401 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.401 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.401 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.401 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.450 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.450 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.450 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.450 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.450 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.450 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.451 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.460 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.461 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.461 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.481 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.481 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.481 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.482 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.482 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.541 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114292541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:52.551 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:24:52.552 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:24:52.600 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.601 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.602 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.781 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:52.781 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:52.781 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:52.781 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.781 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.781 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.781 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.782 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.782 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.782 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.782 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.782 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:52.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:52.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:52.869 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:52.870 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:52.870 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:52.870 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.870 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.870 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:52.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:52.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:52.871 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:52.874 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:52.874 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:52.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:52.874 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:52.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:52.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:52.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:52.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:52.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:52.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:52.875 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:52.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:52.875 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:52.876 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:52.876 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:52.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:52.876 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:52.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:52.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:52.877 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:52.921 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.921 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.921 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.921 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.921 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.921 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.922 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.922 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:52.940 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:52.941 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:52.941 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:52.941 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.941 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.941 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:52.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:52.941 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:52.941 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114293041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:53.050 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:24:53.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:24:53.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:53Z chronyd exiting
14:24:53.140 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:53.141 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:53.141 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:53.141 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:53.141 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:53.141 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:53.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:53.141 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:53.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:53.141 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:53.141 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:53.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:53.141 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:53.149 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:53.149 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:53.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:53.150 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:53.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:53.150 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:53.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:53.150 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:53.150 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:53.150 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:53.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:53.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:53.150 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:53.180 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.180 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.181 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.181 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.181 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.181 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.181 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.181 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.214 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:24:53.215 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:24:53.215 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:24:53.215 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:24:53.216 [INFO - Thread-39] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:24:53.216 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
14:24:53.216 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:24:53.216 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:24:53.216 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:24:53.217 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:24:53.217 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:24:53.217 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
14:24:53.217 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:24:53.218 [INFO - Thread-39] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:24:53.218 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:24:53.218 [INFO - Thread-39] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:24:53.219 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:24:53.219 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
14:24:53.220 [DEBUG - Thread-39] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:53.220 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:24:53.220 [INFO - Thread-39] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:24:53.220 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
14:24:53.220 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:24:53.220 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:24:53.221 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
14:24:53.222 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:24:53.222 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:24:53.222 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:53.222 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:53.222 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:53.222 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:24:53.223 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:24:53.223 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
14:24:53.223 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
14:24:53.224 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6da816e
14:24:53.224 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:53.224 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:24:53.224 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:53.225 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:24:53.225 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:24:53.225 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:24:53.225 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
14:24:53.225 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
14:24:53.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50df0faf
14:24:53.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:53.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:53.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:24:53.226 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:24:53.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50175190
14:24:53.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49e7567b
14:24:53.229 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:24:53.230 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
14:24:53.230 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
14:24:53.230 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:24:53.230 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7544cd1
14:24:53.230 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:53.231 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:53.231 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:24:53.231 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:53.231 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:24:53.231 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:53.232 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.232 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
14:24:53.232 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
14:24:53.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d2bc96
14:24:53.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:24:53.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:24:53.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:24:53.233 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.233 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:24:53.234 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@268dc5f0
14:24:53.234 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.235 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@196d3006
14:24:53.235 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:53.236 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.236 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.236 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.236 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.237 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.237 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:24:53.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.237 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.238 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.238 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.238 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.239 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.241 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.242 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.244 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.244 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.245 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.245 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.245 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.245 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.246 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.246 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.248 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.248 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.248 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.248 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.248 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.249 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.250 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.250 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.250 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.252 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.253 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.253 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.253 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.253 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.253 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.253 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.254 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.254 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.254 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.254 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.254 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.254 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.255 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.259 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.261 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.261 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.261 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.262 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.262 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.262 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.263 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.263 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.263 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.263 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.263 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.263 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.264 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.264 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.264 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.265 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.266 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.266 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.266 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.266 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.271 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:53.271 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:53.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:53.271 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:53.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:53.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:53.271 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:53.271 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:53.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:53.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:53.272 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:53.272 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:53.272 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:53.272 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.273 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.273 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.274 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.274 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.274 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.274 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.274 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.275 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.275 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.276 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.276 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.276 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.276 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.276 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.276 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.276 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.279 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.279 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.280 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.280 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.280 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.281 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.283 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.283 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.287 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.287 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.287 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.287 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.287 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.287 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.287 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.292 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.293 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.294 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.294 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.294 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.294 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.295 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.295 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.295 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.295 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.295 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.295 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.299 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.300 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.300 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.300 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.302 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.302 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.302 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.302 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.302 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.302 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.302 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.303 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.303 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.303 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:53.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.312 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.312 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.312 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.312 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.314 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.314 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.314 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.314 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.314 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.314 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.314 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.314 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.314 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.314 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.315 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.315 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.315 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.319 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.319 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.319 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.319 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.319 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.319 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.319 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.319 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.319 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.319 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.319 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.320 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.323 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.323 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.323 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.323 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.323 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.323 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.323 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.323 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.323 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.323 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.342 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.342 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.342 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.342 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:53.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.343 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.343 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.343 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.343 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.343 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.343 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.343 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.352 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.352 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.353 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.353 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.353 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.353 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.353 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.353 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.354 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.354 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.354 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.354 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.354 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.354 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.354 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.354 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.355 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.355 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.355 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.355 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.355 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.355 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.355 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.356 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:53.356 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:53.356 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:53.356 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.356 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.357 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.357 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.357 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.357 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.357 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.357 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:53.360 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.360 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.360 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.360 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.379 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.379 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.379 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.380 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.380 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.380 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.380 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.380 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.380 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.380 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.380 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.380 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.402 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.402 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.402 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.402 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.402 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.402 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.403 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.412 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.412 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.412 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.412 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.412 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.412 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.412 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.413 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.413 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.413 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.413 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.413 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.413 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.414 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.414 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.414 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.415 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.415 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.415 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.415 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.416 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.482 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.483 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.483 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.492 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.492 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.492 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.492 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.492 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.492 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.493 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.495 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.495 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.495 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.495 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.495 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.495 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.495 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.495 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.495 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.495 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.499 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.500 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.500 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.500 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.500 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.500 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.500 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.500 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.500 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.500 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.500 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.500 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.514 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.514 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.514 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114293541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:53.548 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:24:53.549 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:24:53.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.595 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.595 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.595 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.595 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.595 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.596 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.596 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.596 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.603 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.603 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.603 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.603 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.603 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.603 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.603 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:53.680 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:53.681 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:53.681 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:53.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.681 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.681 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:53.720 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.720 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.720 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.720 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.720 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.721 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.723 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.723 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.723 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.723 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.723 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.723 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.723 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.752 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.753 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.753 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.753 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.753 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.753 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.753 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.753 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.753 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.753 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.753 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.753 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.753 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.795 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.795 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.795 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.796 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:53.812 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:53.812 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:53.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.813 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:53.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:53.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:53.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:53.813 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:53.830 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:53.831 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:53.831 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:53.831 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.831 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.831 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.831 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:53.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:53.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:53.831 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:53.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:53.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.855 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.855 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.855 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.855 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.855 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.893 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.894 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.894 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.894 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.894 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.895 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.895 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.902 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.902 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.902 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.902 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.902 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.902 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.903 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:53.919 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:53.919 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:53.919 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:53.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.920 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:53.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:53.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:53.920 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:54.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114294041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:54.049 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:24:54.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:24:54.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.14:24:54.176 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114294176
14:24:54.176 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114294176
14:24:54.180 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:24:54.183 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:24:54.183 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:24:54.183 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:24:54.184 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:24:54.184 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:24:54.187 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:24:54.204 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:54.205 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:54.205 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:54.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.205 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.206 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:54.264 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:54.265 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:54.265 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:54.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.266 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:54.305 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:54.305 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:54.306 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:54.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.306 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.306 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.306 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:54.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:54.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:54.505 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:24:54.505 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:24:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.508241 17920 mini_oidc.cc:150] Starting JWKS server
14:24:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.511036 17920 webserver.cc:533] Webserver started at http://127.0.0.1:41387/ using document root <none> and password file <none>
14:24:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.511410 17920 mini_oidc.cc:186] Starting OIDC Discovery server
14:24:54.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.512949 17920 webserver.cc:533] Webserver started at http://127.0.0.1:33111/ using document root <none> and password file <none>
14:24:54.531 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:54.531 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:54.532 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:54.532 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.532 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.532 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:54.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.532 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.532 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:54.532 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:54.532 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:54.540 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:54.540 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:54.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.540 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:54.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.540 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:54.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114294541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:54.549 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:24:54.550 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:24:54.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:54Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:24:54.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:24:54Z Disabled control of system clock
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.574039 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/logs
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data/info.pb
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.62:37019
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.62
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json with env {}
14:24:54.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:54.670 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:54.670 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:54.671 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:54.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:54.671 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:54.671 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:54.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:54.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:54.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:54.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:54.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:54.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:54.671 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:54.681 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:54.682 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:54.682 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:54.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:54.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:54.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:54.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:54.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:54.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:54.682 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:54.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:54.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:54.682 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:54.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:54.812 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:54.812 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:54.813 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:54.813 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:54.813 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:54.813 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:54.813 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:54.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:54.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:54.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:54.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:54.813 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:54.813 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:54.825 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:54.825 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:54.825 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:54.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.825 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:54.826 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.826 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.826 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:54.826 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:54.826 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:54.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:54.854 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:54.854 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:54.854 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:54.854 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.854 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.855 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.855 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.855 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.855 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:54.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:54.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:54.855 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:54.855 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.855 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.855 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:54.855 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.855 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.855 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:54.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.856 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.856 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:54.856 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:54.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.875125 17932 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:54.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.875701 17932 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:54.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.876175 17932 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.907189 17932 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.907497 17932 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.907747 17932 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:54.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.907941 17932 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:54.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.908120 17932 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:54.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.908310 17932 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41387/jwks.json
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.944568 17932 master_runner.cc:387] Master server non-default flags:
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.62:37019
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data/info.pb
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.62
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/logs
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:54.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:54.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.946566 17932 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:54.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:54.949182 17932 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:54.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.963502 17938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:54.972 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:54.972 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:54.972 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:54.972 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:54.972 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:54.972 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:54.972 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:54.972 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:54.972 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:54.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:54.973 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:54.973 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:54.973 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:55.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114295041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:55.052 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:55.054 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:24:55.110 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:55.110 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:55.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:55.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:55.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:55.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:55.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:55.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:55.112 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:55.110 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:55.112 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:55.112 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:55.112 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:55.112 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:55.152 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:55.152 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:55.152 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:55.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.154 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.154 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:55.252 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:55.253 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:55.253 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:55.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:55.254 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:55.254 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:55.254 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:55.254 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:55.254 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:55.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:55.255 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:55.255 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:55.255 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:55.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:55.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:55.479 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:55.480 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:55.480 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:55.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.481 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.481 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.481 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.482 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:55.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114295541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:55.543 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:55.543 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:55.543 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:55.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:55.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:55.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:55.545 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:55.545 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:55.545 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:55.545 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:55.545 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:55.545 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:55.545 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:55.556 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:24:55.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:24:55.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:55.677 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:55.677 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:55.677 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:55.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:55.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:55.679 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.679 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.679 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:55.679 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:55.762 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:55.763 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:55.763 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:55.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:55.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:55.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:55.765 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:55.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:55.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114296042 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:56.060 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:24:56.062 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:24:56.074 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:56.075 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:56.075 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:56.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.076 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.076 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.076 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.077 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.077 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.077 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.077 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:56.078 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:56.078 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:56.078 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:56.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:56.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:56.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:56.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:56.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:56.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:56.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:56.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:56.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:56.080 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:56.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.194 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:56.194 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:56.194 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:56.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:56.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:56.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:56.196 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:56.196 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:56.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:56.196 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:56.196 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:56.196 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:56.196 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:56.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114296541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:56.557 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:24:56.560 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:24:56.562 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:56.562 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:56.562 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:56.563 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.563 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.563 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:56.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:56.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:56.564 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:56.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.367326 17937 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 17932
14:24:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:54.964869 17939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.711397 17932 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.747s	user 0.643s	sys 1.098s
14:24:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.712443 17932 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.748s	user 0.643s	sys 1.099s
14:24:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.714239 17941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:56.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.716840 17940 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1747 milliseconds
14:24:56.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.716909 17932 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:56.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.718250 17932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:56.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.720882 17932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:56.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.722359 17932 hybrid_clock.cc:648] HybridClock initialized: now 1779114296722278 us; error 28 us; skew 500 ppm
14:24:56.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.723124 17932 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:56.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.729171 17932 webserver.cc:533] Webserver started at http://127.17.128.62:43075/ using document root <none> and password file <none>
14:24:56.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.729967 17932 fs_manager.cc:362] Metadata directory not provided
14:24:56.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.730216 17932 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:56.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.730571 17932 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:56.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.734719 17932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data/instance:
14:24:56.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "264dd986fc6f45958df3be27a535b5e4"
14:24:56.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:56 on dist-test-slave-1n46"
14:24:56.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.735811 17932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal/instance:
14:24:56.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "264dd986fc6f45958df3be27a535b5e4"
14:24:56.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:56 on dist-test-slave-1n46"
14:24:56.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.742926 17932 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
14:24:56.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.748775 17948 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.749907 17932 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
14:24:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.750248 17932 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal
14:24:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "264dd986fc6f45958df3be27a535b5e4"
14:24:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:56 on dist-test-slave-1n46"
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.750521 17932 fs_report.cc:389] FS layout report
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data/data
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:56.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.822605 17932 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:56.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.824126 17932 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:56.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.824507 17932 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:56.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:56.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.901695 17932 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.62:37019
14:24:56.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.901733 17999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.62:37019 every 8 connection(s)
14:24:56.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.904693 17932 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/data/info.pb
14:24:56.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.907938 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 17932
14:24:56.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.908568 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-0/wal/instance
14:24:56.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.911406 18000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.912184 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/logs
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data/info.pb
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.61:34199
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.61
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:56.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json with env {}
14:24:56.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.923341 18000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } has no permanent_uuid. Determining permanent_uuid...
14:24:56.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:56.957125 18000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } has no permanent_uuid. Determining permanent_uuid...
14:24:56.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.959348 17951 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:56.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:56.963510 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.012955 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 1
14:24:57.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.017053 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114297041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:57.051 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:24:57.052 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:24:57.071 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:57.071 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:57.071 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:57.071 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.071 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.071 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.071 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.072 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.071 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.072 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:57.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.085418 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 2
14:24:57.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.089259 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.180608 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 3
14:24:57.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.184615 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.234 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:57.235 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:57.235 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:57.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.235 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.235 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.235 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.235 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:57.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.240864 18002 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:57.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.241458 18002 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:57.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.242108 18002 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:57.270 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:57.270 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:57.270 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:57.270 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:57.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:57.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:57.270 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:57.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:57.270 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:57.270 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:57.270 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:57.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:57.271 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:57.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.274488 18002 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:57.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.274797 18002 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:57.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.275004 18002 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:57.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.275244 18002 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:57.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.275499 18002 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:57.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.275663 18002 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41387/jwks.json
14:24:57.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.311352 18002 master_runner.cc:387] Master server non-default flags:
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.61:34199
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data/info.pb
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.61
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/logs
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.312722 18002 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:57.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.314446 18002 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.324422 18012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:57.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.327960 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 4
14:24:57.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.335337 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.455 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:57.456 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:57.456 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:57.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.458 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:57.481 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:57.481 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:57.481 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:57.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.482 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.482 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.483 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:57.541 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114297541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:57.556 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:24:57.557 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:24:57.564 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:57.564 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:57.564 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:57.565 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.565 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.565 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:57.566 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.566 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:57.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.566 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:57.566 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:57.586 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:57.586 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:57.586 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:57.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.587 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.587 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.587 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.588 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:57.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:57.634892 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 5
14:24:57.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.642809 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:57.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:57.934 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:57.934 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:57.934 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:57.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:57.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:57.936 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:57.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:57.961 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:57.961 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:57.962 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:57.962 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.962 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.962 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:57.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:57.963 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.963 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:57.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:58.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114298041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:58.059 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:24:58.062 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:24:58.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.111 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:24:58.112 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:24:58.112 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:24:58.112 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:58.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:58.113 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:24:58.113 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:58.113 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:58.113 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:24:58.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:58.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:58.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:24:58.114 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:24:58.132 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:58.132 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:58.132 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:58.133 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.133 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.133 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.133 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.134 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:58.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.190352 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 6
14:24:58.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.212642 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.61:34199: Network error: Client connection negotiation failed: client connection to 127.17.128.61:34199: connect: Connection refused (error 111)
14:24:58.251 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:58.251 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:58.251 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:58.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:58.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:58.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:58.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:58.253 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:58.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:58.253 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:58.253 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:58.253 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:58.253 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:58.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:24:58.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:24:58.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:24:58.393 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.393 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.393 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:24:58.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:24:58.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:24:58.395 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:24:58.405 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:58.405 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:58.405 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:58.406 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.406 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.407 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:58.420 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:58.421 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:58.421 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:58.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.422 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:58.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.422 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:58.422 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.422 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.423 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:58.423 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:58.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114298541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:58.549 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:24:58.550 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:24:58.550 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:24:58.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:58.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:58.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:24:58.551 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:58.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:58.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:24:58.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:58.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:58.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:24:58.552 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:24:58.552 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:24:58.553 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:24:58.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:57.326609 18013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:58.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.724301 18015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:58.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.728264 18014 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1401 milliseconds
14:24:58.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.728744 18002 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.403s	user 0.404s	sys 0.973s
14:24:58.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.728977 18002 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.403s	user 0.404s	sys 0.973s
14:24:58.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.729130 18002 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:24:58.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.730245 18002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:24:58.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.733024 18002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:24:58.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.734493 18002 hybrid_clock.cc:648] HybridClock initialized: now 1779114298734412 us; error 75 us; skew 500 ppm
14:24:58.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.735625 18002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:24:58.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.744458 18002 webserver.cc:533] Webserver started at http://127.17.128.61:33223/ using document root <none> and password file <none>
14:24:58.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.746006 18002 fs_manager.cc:362] Metadata directory not provided
14:24:58.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.746344 18002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:24:58.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.747069 18002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:24:58.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.754261 18002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data/instance:
14:24:58.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7944a7d7a29144f9bc004e40370f7f21"
14:24:58.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:58 on dist-test-slave-1n46"
14:24:58.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.755911 18002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal/instance:
14:24:58.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7944a7d7a29144f9bc004e40370f7f21"
14:24:58.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:58 on dist-test-slave-1n46"
14:24:58.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.765684 18002 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
14:24:58.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.774085 18024 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:24:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.775159 18002 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:24:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.775518 18002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal
14:24:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7944a7d7a29144f9bc004e40370f7f21"
14:24:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:24:58 on dist-test-slave-1n46"
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.775864 18002 fs_report.cc:389] FS layout report
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data/data
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:24:58.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:24:58.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:58.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.859880 18002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:24:58.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.861409 18002 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:24:58.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.861840 18002 kserver.cc:163] Server-wide thread pool size limit: 3276
14:24:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.938676 18002 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.61:34199
14:24:58.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.938824 18075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.61:34199 every 8 connection(s)
14:24:58.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.941483 18002 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/data/info.pb
14:24:58.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.946882 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18002
14:24:58.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.947273 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-1/wal/instance
14:24:58.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.947757 18076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.949282 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/logs
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data/info.pb
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.60:42293
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.60
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json with env {}
14:24:58.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.958988 18076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } has no permanent_uuid. Determining permanent_uuid...
14:24:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.981133 18076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } has no permanent_uuid. Determining permanent_uuid...
14:24:58.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:58.995599 18076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
14:24:58.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:58.997807 18025 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.002056 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.040 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:59.040 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:59.040 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:59.041 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.041 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:59.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114299041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:59.050 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:24:59.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:24:59.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.051618 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 1
14:24:59.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.057091 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.125527 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 2
14:24:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.129410 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.201 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:59.201 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:59.202 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:59.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.202 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.202 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.202 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.202 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.202 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.202 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.202 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.202 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:59.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.220784 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 3
14:24:59.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.224514 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.266908 18078 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:24:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.267598 18078 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:24:59.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.268138 18078 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:24:59.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.273258 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } attempt: 7
14:24:59.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.285065 18000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
14:24:59.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.290211 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.305473 18078 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:24:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.305806 18078 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:24:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.306128 18078 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:24:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.306360 18078 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:24:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.306561 18078 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:24:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.306710 18078 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41387/jwks.json
14:24:59.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.343415 18078 master_runner.cc:387] Master server non-default flags:
14:24:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:24:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:24:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:24:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.60:42293
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41387/jwks.json
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data/info.pb
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.60
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/logs
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:24:59.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:24:59.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.345126 18078 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:24:59.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.347262 18078 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:24:59.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.348579 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 1
14:24:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.352756 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.358685 18090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:24:59.362 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:24:59.363 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:24:59.363 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:24:59.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:59.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:59.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:24:59.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:59.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:59.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:24:59.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:59.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:59.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:24:59.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:24:59.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.367851 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 4
14:24:59.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.373495 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.374 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:59.374 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:59.375 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:59.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.375 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.376 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.376 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.376 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:59.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.434167 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 2
14:24:59.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.441133 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.471 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:24:59.471 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:24:59.471 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:24:59.472 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.472 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.472 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:24:59.473 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.473 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.473 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:24:59.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:24:59.473 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:24:59.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.526623 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 3
14:24:59.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.535120 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114299541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:24:59.555 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:24:59.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:24:59.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.672940 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 5
14:24:59.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.677217 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 4
14:24:59.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.687299 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.690932 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:24:59.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:24:59.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:24:59.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:24:59.724 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.724 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.724 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:24:59.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:24:59.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:24:59.725 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:24:59.785 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:24:59.785 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:24:59.785 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:24:59.786 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:59.786 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:59.786 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:24:59.787 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:59.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:59.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:24:59.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:59.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:59.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:24:59.788 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:24:59.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:24:59.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:24:59.974502 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 5
14:24:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.984431 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:25:00.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114300042 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:00.054 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:00.056 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:25:00.096 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:00.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:00.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:00.098 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.098 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.098 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.099 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.099 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.099 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.099 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.099 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.099 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.099 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:00.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.152 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:00.153 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:00.153 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:00.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:00.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:00.154 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:00.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:00.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:00.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:00.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:00.155 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:00.155 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:00.155 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:00.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.234879 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 6
14:25:00.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.256403 18076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:25:00.308 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.491 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:00.492 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:00.492 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:00.492 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:00.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:00.493 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:00.493 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:00.493 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:00.493 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:00.493 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:00.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:00.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:00.494 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:00.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.536993 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 6
14:25:00.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114300542 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:00.560 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:25:00.561 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:25:00.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.563583 18000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.128.60:42293: Network error: Client connection negotiation failed: client connection to 127.17.128.60:42293: connect: Connection refused (error 111)
14:25:00.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.700 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:00.701 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:00.701 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:00.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.702 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.702 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.702 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.703 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:00.713 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:00.714 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:00.714 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:00.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.715 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.715 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.715 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.715 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.715 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.715 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:00.715 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:00.716 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:00.716 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:00.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.716 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.716 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.717 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:00.771 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:00.771 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:00.772 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:00.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:00.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:00.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:00.774 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:00.808 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:00.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:24:59.359354 18091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:00.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.766762 18089 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 18078
14:25:00.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.909273 18078 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.550s	user 0.507s	sys 1.037s
14:25:00.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.911581 18078 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.553s	user 0.508s	sys 1.038s
14:25:00.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.911772 18093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:00.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:00.914921 18092 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1550 milliseconds
14:25:00.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.915004 18078 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:00.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.916494 18078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:00.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.918882 18078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:00.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.920197 18078 hybrid_clock.cc:648] HybridClock initialized: now 1779114300920167 us; error 53 us; skew 500 ppm
14:25:00.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.920976 18078 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:00.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.926930 18078 webserver.cc:533] Webserver started at http://127.17.128.60:38095/ using document root <none> and password file <none>
14:25:00.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.927793 18078 fs_manager.cc:362] Metadata directory not provided
14:25:00.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.928021 18078 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:00.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.928510 18078 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.932643 18078 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data/instance:
14:25:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "11090082e06a4af988988cdec89caaea"
14:25:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:00 on dist-test-slave-1n46"
14:25:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.933643 18078 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal/instance:
14:25:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "11090082e06a4af988988cdec89caaea"
14:25:00.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:00 on dist-test-slave-1n46"
14:25:00.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.942399 18078 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
14:25:00.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.949666 18104 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:00.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.950822 18078 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:25:00.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.951156 18078 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal
14:25:00.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "11090082e06a4af988988cdec89caaea"
14:25:00.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:00 on dist-test-slave-1n46"
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:00.951499 18078 fs_report.cc:389] FS layout report
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data/data
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:00.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:00.994 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:00.994 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:00.994 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:00.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.995 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:00.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.995 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.995 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.995 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:00.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:00.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:01.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.009387 18078 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:01.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.010955 18078 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:01.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.011499 18078 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:01.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114301041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:01.049 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:25:01.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:25:01.057 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:01.057 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:01.057 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:01.058 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.058 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.059 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:01.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.093335 18078 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.60:42293
14:25:01.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.093357 18155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.60:42293 every 8 connection(s)
14:25:01.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.097304 18078 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/data/info.pb
14:25:01.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.103735 18156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:01.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.105260 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18078
14:25:01.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.105717 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/master-2/wal/instance
14:25:01.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.118412 18156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } has no permanent_uuid. Determining permanent_uuid...
14:25:01.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.149065 18156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } has no permanent_uuid. Determining permanent_uuid...
14:25:01.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.158458 18156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
14:25:01.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.173095 18156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: Bootstrap starting.
14:25:01.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.179792 18156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: Neither blocks nor log segments found. Creating new log.
14:25:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.181603 18156 log.cc:826] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: Log is configured to *not* fsync() on all Append() calls
14:25:01.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.186842 18156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: No bootstrap required, opened a new log
14:25:01.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.205596 18156 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.206260 18156 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:01.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.206552 18156 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11090082e06a4af988988cdec89caaea, State: Initialized, Role: FOLLOWER
14:25:01.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.207302 18156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.209870 18165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.210511 18165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.211308 18156 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: configured and running, proceeding with master startup.
14:25:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:01.237651 18176 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:25:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:01.237985 18176 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:25:01.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.232826 18078 master_runner.cc:187] Error getting master registration for 127.17.128.62:37019: OK, instance_id { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" instance_seqno: 1779114296881224 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:01.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.254422 18078 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:01.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:01.266528 18110 tablet.cc:2404] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:01.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.308781 18165 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:01.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.309310 18165 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.312318 18165 leader_election.cc:290] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264dd986fc6f45958df3be27a535b5e4 (127.17.128.62:37019), 7944a7d7a29144f9bc004e40370f7f21 (127.17.128.61:34199)
14:25:01.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.316968 18076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 7
14:25:01.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:01.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:01.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:01.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.336 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:01.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.337174 18076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: Bootstrap starting.
14:25:01.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.348846 18076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: Neither blocks nor log segments found. Creating new log.
14:25:01.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.351135 18076 log.cc:826] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: Log is configured to *not* fsync() on all Append() calls
14:25:01.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.355858 18076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: No bootstrap required, opened a new log
14:25:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.375085 18076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.375699 18076 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:01.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.375972 18076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7944a7d7a29144f9bc004e40370f7f21, State: Initialized, Role: FOLLOWER
14:25:01.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.376754 18076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.379 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:01.379 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:01.380 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.379570 18180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:01.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:01.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.380455 18180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.380 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:01.381 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:01.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:01.381 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:01.381 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:01.381 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:01.381 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:01.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.381291 18076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: configured and running, proceeding with master startup.
14:25:01.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.381927 18051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11090082e06a4af988988cdec89caaea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7944a7d7a29144f9bc004e40370f7f21" is_pre_election: true
14:25:01.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.382692 18051 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11090082e06a4af988988cdec89caaea in term 0.
14:25:01.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.384008 18107 leader_election.cc:304] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11090082e06a4af988988cdec89caaea, 7944a7d7a29144f9bc004e40370f7f21; no voters: 
14:25:01.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.385046 18165 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:01.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.385402 18165 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:01.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.385735 18165 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 0 FOLLOWER]: Advancing to term 1
14:25:01.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.392367 18165 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.396991 18051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11090082e06a4af988988cdec89caaea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7944a7d7a29144f9bc004e40370f7f21"
14:25:01.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.397590 18051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 0 FOLLOWER]: Advancing to term 1
14:25:01.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.399077 18165 leader_election.cc:290] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [CANDIDATE]: Term 1 election: Requested vote from peers 264dd986fc6f45958df3be27a535b5e4 (127.17.128.62:37019), 7944a7d7a29144f9bc004e40370f7f21 (127.17.128.61:34199)
14:25:01.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.410380 18051 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11090082e06a4af988988cdec89caaea in term 1.
14:25:01.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.411386 18107 leader_election.cc:304] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11090082e06a4af988988cdec89caaea, 7944a7d7a29144f9bc004e40370f7f21; no voters: 
14:25:01.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.412273 18165 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 1 FOLLOWER]: Leader election won for term 1
14:25:01.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.415416 18165 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [term 1 LEADER]: Becoming Leader. State: Replica: 11090082e06a4af988988cdec89caaea, State: Running, Role: LEADER
14:25:01.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.416406 18165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.433010 18188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11090082e06a4af988988cdec89caaea. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.436677 18188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: This master's current role is: LEADER
14:25:01.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.442025 18192 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:25:01.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.450814 18194 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:25:01.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.458482 18192 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:25:01.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.476599 18051 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [term 1 FOLLOWER]: Refusing update from remote peer 11090082e06a4af988988cdec89caaea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.478447 18165 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.455000 18002 master_runner.cc:187] Error getting master registration for 127.17.128.62:37019: OK, instance_id { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" instance_seqno: 1779114296881224 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.483386 18002 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:01.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.499925 18180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11090082e06a4af988988cdec89caaea. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.500588 18180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.504737 18195 mvcc.cc:204] Tried to move back new op lower bound from 7287252178827014144 to 7287252178612604928. Current Snapshot: MvccSnapshot[applied={T|T < 7287252178827014144}]
14:25:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.507727 18165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.508471 18165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: This master's current role is: LEADER
14:25:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.509131 18196 mvcc.cc:204] Tried to move back new op lower bound from 7287252178827014144 to 7287252178612604928. Current Snapshot: MvccSnapshot[applied={T|T < 7287252178827014144}]
14:25:01.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.510880 18180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.511524 18180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.516618 18192 catalog_manager.cc:1383] Generated new cluster ID: d03a42031c114afaa060ce9e74b659b6
14:25:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.516932 18192 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:25:01.525 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:01.525 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:01.526 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:01.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:01.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:01.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:01.526 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:01.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114301541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.542469 18192 catalog_manager.cc:1406] Generated new certificate authority record
14:25:01.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.544664 18192 catalog_manager.cc:1540] Loading token signing keys...
14:25:01.552 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:01.552 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:25:01.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.573536 18192 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea: Generated new TSK 0
14:25:01.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.574892 18192 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:25:01.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.597090 18000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } attempt: 7
14:25:01.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.615355 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/logs
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data/info.pb
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.1:0
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.1
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.1
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:01.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.621858 18000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: Bootstrap starting.
14:25:01.624 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:01.625 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:01.625 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:01.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.626 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.626 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:01.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.631583 18000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: Neither blocks nor log segments found. Creating new log.
14:25:01.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.634363 18000 log.cc:826] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: Log is configured to *not* fsync() on all Append() calls
14:25:01.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.641315 18000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: No bootstrap required, opened a new log
14:25:01.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.682734 18000 raft_consensus.cc:359] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.683761 18000 raft_consensus.cc:385] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:01.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.684166 18000 raft_consensus.cc:740] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264dd986fc6f45958df3be27a535b5e4, State: Initialized, Role: FOLLOWER
14:25:01.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.685586 18000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } }
14:25:01.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.690001 18000 sys_catalog.cc:565] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: configured and running, proceeding with master startup.
14:25:01.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.690167 17975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11090082e06a4af988988cdec89caaea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264dd986fc6f45958df3be27a535b5e4" is_pre_election: true
14:25:01.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.691013 17975 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11090082e06a4af988988cdec89caaea in term 0.
14:25:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.692345 17973 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 0 FOLLOWER]: Advancing to term 1
14:25:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.695341 17974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11090082e06a4af988988cdec89caaea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264dd986fc6f45958df3be27a535b5e4"
14:25:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.701140 17973 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [term 1 FOLLOWER]: Refusing update from remote peer 11090082e06a4af988988cdec89caaea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.689390 18203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.702945 18203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.703078 18165 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [LEADER]: Connected to new peer: Peer: permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:01.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.759698 18203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11090082e06a4af988988cdec89caaea. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.760617 18203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.761904 18211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:01.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.762761 18211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4 [sys.catalog]: This master's current role is: FOLLOWER
14:25:01.765 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:01.765 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:01.765 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:01.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.766 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.767 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.767 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.767 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.767 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:01.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.800788 18219 catalog_manager.cc:1295] Loaded cluster ID: d03a42031c114afaa060ce9e74b659b6
14:25:01.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.801200 18219 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: loading cluster ID for follower catalog manager: success
14:25:01.807 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.808604 18219 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: acquiring CA information for follower catalog manager: success
14:25:01.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:01.814215 18219 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 264dd986fc6f45958df3be27a535b5e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:01.830 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:01.830 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:01.830 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:01.830 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:01.831 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:01.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:01.831 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:01.831 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:01.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:01.831 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:01.831 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:01.831 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:01.831 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:01.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:01.924 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:01.925 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:01.925 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:01.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:01.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.926 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:01.926 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.926 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:01.926 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:02.015 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:02.015 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:02.015 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:02.016 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.016 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.016 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.016 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.016 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.017 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:02.041 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:02.041 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:02.041 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:02.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.042 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.042 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.042 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:02.047 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114302041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:02.055 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:25:02.056 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:25:02.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:02.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:02.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:02.162 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:02.163 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:02.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:02.163 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:02.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:02.163 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:02.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:02.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:02.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:02.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:02.163 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:02.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.177698 18201 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:02.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.178532 18201 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.179323 18201 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:02.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.234988 18201 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:02.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.236467 18201 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.128.1
14:25:02.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:02.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:02.246 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:02.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.247 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.247 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.247 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.247 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.247 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.248 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:02.252 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:02.252 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:02.252 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:02.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:02.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:02.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:02.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:02.253 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:02.253 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:02.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:02.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:02.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:02.253 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:02.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.289731 18165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11090082e06a4af988988cdec89caaea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "264dd986fc6f45958df3be27a535b5e4" member_type: VOTER last_known_addr { host: "127.17.128.62" port: 37019 } } peers { permanent_uuid: "7944a7d7a29144f9bc004e40370f7f21" member_type: VOTER last_known_addr { host: "127.17.128.61" port: 34199 } } peers { permanent_uuid: "11090082e06a4af988988cdec89caaea" member_type: VOTER last_known_addr { host: "127.17.128.60" port: 42293 } } }
14:25:02.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.290618 18165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11090082e06a4af988988cdec89caaea [sys.catalog]: This master's current role is: LEADER
14:25:02.303 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:02.303 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:02.303 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:02.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:02.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.303462 18201 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:02.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:02.303 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:02.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:02.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.1:0
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data/info.pb
14:25:02.304 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.1
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.1
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/logs
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:02.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:02.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:02.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:02.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:02.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:02.304 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.306344 18201 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:02.307 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:02.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.308409 18201 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:02.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.325834 18228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:02.344 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:02.420 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:02.421 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:02.421 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:02.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.422 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:02.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:02.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.422 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:02.422 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:02.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.477991 18194 catalog_manager.cc:1295] Loaded cluster ID: d03a42031c114afaa060ce9e74b659b6
14:25:02.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.478437 18194 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: loading cluster ID for follower catalog manager: success
14:25:02.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.499547 18194 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: acquiring CA information for follower catalog manager: success
14:25:02.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:02.504729 18194 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 7944a7d7a29144f9bc004e40370f7f21: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:02.506 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:02.506 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:02.506 [DEBUG - pool-171-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:02.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.507 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.507 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:02.508 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27008), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [15ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [25ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [285ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [285ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [365ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [367ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [371ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [371ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [5560ms] refreshing cache from master, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5561ms] too many traces: truncated at 100 traces, deferred=Deferred@1165739645(state=PENDING, result=null, callback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016), errback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016)))
14:25:02.508 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:25:02.509 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27008), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [15ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [25ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [285ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [285ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [365ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [367ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [371ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [371ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [5560ms] refreshing cache from master, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5561ms] too many traces: truncated at 100 traces, deferred=Deferred@1165739645(state=PENDING, result=null, callback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016), errback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:02.509 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:25:02.513 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:25:02.515 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27008), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [15ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [25ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [285ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [285ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [365ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [367ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [371ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [371ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [5560ms] refreshing cache from master, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5561ms] too many traces: truncated at 100 traces, deferred=Deferred@1165739645(state=PENDING, result=null, callback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016), errback=(continuation of Deferred@280642483 after retry RPC after error@1914178200) -> (continuation of Deferred@124888339 after retry RPC after error@480433070) -> (continuation of Deferred@1590144082 after retry RPC after error@1815687640) -> (continuation of Deferred@1718245489 after retry RPC after error@1818216625) -> (continuation of Deferred@253320276 after retry RPC after error@705366942) -> (continuation of Deferred@513177470 after retry RPC after error@203304541) -> (continuation of Deferred@1235236982 after retry RPC after error@998608167) -> (continuation of Deferred@369438894 after retry RPC after error@1796511989) -> (continuation of Deferred@599752297 after retry RPC after error@885273484) -> (continuation of Deferred@192673274 after retry RPC after error@1147606864) -> (continuation of Deferred@477328771 after retry RPC after error@155086290) -> (continuation of Deferred@1564380458 after retry RPC after error@555732042) -> (continuation of Deferred@650603143 after retry RPC after error@1559090032) -> (continuation of Deferred@1964196378 after retry RPC after error@707898734) -> (continuation of Deferred@926902781 after retry RPC after error@100358713) -> (continuation of Deferred@1779944206 after retry RPC after error@1307202047) -> (continuation of Deferred@30845246 after retry RPC after error@1579356591) -> (continuation of Deferred@171507422 after retry RPC after error@356656079) -> (continuation of Deferred@560592640 after retry RPC after error@1728132331) -> (continuation of Deferred@713222363 after retry RPC after error@777714207) -> (continuation of Deferred@1088805155 after retry RPC after error@783096760) -> (continuation of Deferred@332724870 after retry RPC after error@1789358305) -> (continuation of Deferred@82149463 after retry RPC after error@1112751016)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:02.518 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:02.524 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
14:25:02.524 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:25:02.524 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:25:02.525 [WARN - flink-pekko.actor.default-dispatcher-6] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
14:25:02.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114302541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:02.551 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:25:02.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:25:02.612 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:02.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:02.871 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:02.871 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:02.872 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:02.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:02.872 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:02.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:02.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:02.872 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:02.872 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:02.872 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:02.872 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:02.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:02.872 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:02.931 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:02.932 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:02.932 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:02.932 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:02.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.933 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:02.934 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.934 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.934 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:02.934 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:03.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114303041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:03.052 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:03.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:25:03.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:03.161 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:03.162 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:03.162 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:03.163 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.163 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:03.212 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:03.213 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:03.213 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:03.214 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.214 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.214 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.215 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:03.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:03.396 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:03.396 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:03.396 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:03.397 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.397 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.397 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.397 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.397 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.397 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.398 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.398 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.398 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:03.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114303541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:03.552 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:03.553 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:03.553 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:03.553 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:03.554 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.554 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.554 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:03.554 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:25:03.554 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:03.555 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:03.556 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:25:03.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:03.695 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:03.695 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:03.696 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:03.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:03.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:03.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:03.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:03.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:03.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:03.698 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:03.698 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:03.698 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:03.698 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:03.771 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:03.771 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:03.771 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:03.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.772 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.772 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.772 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.772 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.772 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.773 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:03.813 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:03.814 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:03.814 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:03.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:03.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:03.815 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:03.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:03.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:03.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:03.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:03.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:03.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:03.815 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:03.831 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:03.831 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:03.831 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:03.831 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:03.832 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.832 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.832 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:03.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.832 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:03.832 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:03.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:03.887 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:25:03.889 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:25:03.890 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:25:03.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
14:25:03.894 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
14:25:03.895 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:03.896 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
14:25:03.896 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:25:03.896 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:25:03.897 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:25:03.916 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
14:25:03.916 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
14:25:03.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32bdc936
14:25:03.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:03.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:03.921 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:25:03.921 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:25:03.949 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2da7d213
14:25:03.965 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:03.969 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:03.974 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:03.975 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:03.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.977 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.978 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.978 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.978 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:03.989 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:03.992 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:03.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:03.993 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:03.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.994 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:03.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:03.996 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.009 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.013 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.014 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.016 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.016 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.028 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.029 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.029 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.029 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.030 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.030 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.034 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:04.034 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:04.034 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:04.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.036 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.036 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.036 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.036 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:04.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114304041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:04.049 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:25:04.049 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.049 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.049 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:25:04.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.050 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.050 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.050 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.051 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.089 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.089 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.089 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.090 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.090 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.090 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.090 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.090 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.090 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.091 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.091 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.109 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.109 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.109 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.109 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.109 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.110 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.110 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.169 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:03.726862 18227 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 18201
14:25:04.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:02.332706 18229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:04.185159 18201 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.854s	user 0.494s	sys 0.904s
14:25:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:04.187500 18201 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.857s	user 0.494s	sys 0.905s
14:25:04.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.190 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.190 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.190 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.190 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.191 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.192 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:04.192 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:04.192 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:04.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.193 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.193 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.193 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.195 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.195 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:04.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.205854 18201 server_base.cc:1061] running on GCE node
14:25:04.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:04.205731 18245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:04.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.209528 18201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:04.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.221794 18201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:04.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.229609 18201 hybrid_clock.cc:648] HybridClock initialized: now 1779114304229555 us; error 54 us; skew 500 ppm
14:25:04.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.230856 18201 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:04.250 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:04.250 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:04.250 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:04.251 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:04.251 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:04.251 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:04.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:04.252 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:04.252 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:04.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:04.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:04.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:04.252 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:04.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.262749 18201 webserver.cc:533] Webserver started at http://127.17.128.1:40713/ using document root <none> and password file <none>
14:25:04.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.264297 18201 fs_manager.cc:362] Metadata directory not provided
14:25:04.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.264730 18201 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:04.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.265374 18201 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.272189 18201 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data/instance:
14:25:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4c5a90a953ad4b5681643a81a5370633"
14:25:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:04 on dist-test-slave-1n46"
14:25:04.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.273823 18201 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal/instance:
14:25:04.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4c5a90a953ad4b5681643a81a5370633"
14:25:04.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:04 on dist-test-slave-1n46"
14:25:04.290 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.290 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.290 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.291 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.291 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.291 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.291 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.291 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.292 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.301085 18201 fs_manager.cc:696] Time spent creating directory manager: real 0.026s	user 0.012s	sys 0.012s
14:25:04.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:04.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:04.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:04.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:04.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.314 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:04.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:04.314 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.318874 18250 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:04.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.322738 18201 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.010s	sys 0.003s
14:25:04.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.323312 18201 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal
14:25:04.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4c5a90a953ad4b5681643a81a5370633"
14:25:04.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:04 on dist-test-slave-1n46"
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.323966 18201 fs_report.cc:389] FS layout report
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data/data
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:04.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:04.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.424477 18201 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:04.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.426909 18201 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:04.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.427784 18201 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:04.429 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.429 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.430 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.431 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.431 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.431 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.436 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.437 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.437 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.437 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.437 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.437484 18201 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:04.438 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.438 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.438 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.438 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.449924 18201 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:04.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.450323 18201 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
14:25:04.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.450736 18201 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:04.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:04.451016 18201 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:04.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114304542 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:04.550 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:04.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:25:04.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.615 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:04.615 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:04.616 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:04.616 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.616 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.616 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:04.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:04.617 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.617 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.617 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:04.617 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:04.656 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.656 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.656 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.657 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.657 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.658 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.658 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.658 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.658 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.669 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.741 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.741 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.741 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.743 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.744 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [13ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [66ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [68ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [124ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [503ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [841ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [842ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [923ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2421ms] refreshing cache from master, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4581ms] refreshing cache from master, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4582ms] too many traces: truncated at 100 traces, deferred=Deferred@89588097(state=PENDING, result=null, callback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779), errback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779)))
14:25:04.745 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:25:04.745 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [13ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [66ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [68ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [124ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [503ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [841ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [842ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [923ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2421ms] refreshing cache from master, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4581ms] refreshing cache from master, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4582ms] too many traces: truncated at 100 traces, deferred=Deferred@89588097(state=PENDING, result=null, callback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779), errback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.746 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
14:25:04.748 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:25:04.750 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [13ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [66ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [68ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [124ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [503ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [503ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [841ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [842ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [922ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [923ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2421ms] refreshing cache from master, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4581ms] refreshing cache from master, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4582ms] too many traces: truncated at 100 traces, deferred=Deferred@89588097(state=PENDING, result=null, callback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779), errback=(continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785) -> (continuation of Deferred@1764497825 after retry RPC after error@2106480052) -> (continuation of Deferred@1264853017 after retry RPC after error@152455197) -> (continuation of Deferred@16693647 after retry RPC after error@257060817) -> (continuation of Deferred@1708978890 after retry RPC after error@1580271820) -> (continuation of Deferred@737599556 after retry RPC after error@935734796) -> (continuation of Deferred@890159260 after retry RPC after error@1664076185) -> (continuation of Deferred@2135417208 after retry RPC after error@2046236370) -> (continuation of Deferred@977154896 after retry RPC after error@666912399) -> (continuation of Deferred@1741434670 after retry RPC after error@642573443) -> (continuation of Deferred@1839458217 after retry RPC after error@1215443116) -> (continuation of Deferred@1321321427 after retry RPC after error@258494068) -> (continuation of Deferred@2097446559 after retry RPC after error@615171779)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.751 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:25:04.751 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:25:04.752 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:04.752 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
14:25:04.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:04.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:04.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:04.864 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:04.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:04.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:04.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:04.866 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:04.866 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:04.866 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:04.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:04.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:04.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:04.866 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:04.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:04.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:04.891 [DEBUG - pool-170-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:04.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:04.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:04.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:04.892 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:04.893 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [23ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [70ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [96ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [223ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [883ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1180ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1183ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2943ms] refreshing cache from master, [2943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2945ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [4001ms] refreshing cache from master, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@2094269382(state=PENDING, result=null, callback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930), errback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930)))
14:25:04.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:25:04.893 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [23ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [70ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [96ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [223ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [883ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1180ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1183ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2943ms] refreshing cache from master, [2943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2945ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [4001ms] refreshing cache from master, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@2094269382(state=PENDING, result=null, callback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930), errback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.894 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:25:04.896 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:25:04.898 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [23ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [70ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [70ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [96ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [223ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [883ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1180ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1183ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2943ms] refreshing cache from master, [2943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2945ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [4001ms] refreshing cache from master, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@2094269382(state=PENDING, result=null, callback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930), errback=(continuation of Deferred@1620475412 after retry RPC after error@1760191025) -> (continuation of Deferred@1054083267 after retry RPC after error@1648555756) -> (continuation of Deferred@838287982 after retry RPC after error@171394443) -> (continuation of Deferred@339465758 after retry RPC after error@1639692259) -> (continuation of Deferred@1783917960 after retry RPC after error@1518298708) -> (continuation of Deferred@272547875 after retry RPC after error@747010408) -> (continuation of Deferred@1702324573 after retry RPC after error@1151073889) -> (continuation of Deferred@583143689 after retry RPC after error@1032872192) -> (continuation of Deferred@1676925550 after retry RPC after error@2013284487) -> (continuation of Deferred@1249395927 after retry RPC after error@1952359673) -> (continuation of Deferred@159588534 after retry RPC after error@1933378929) -> (continuation of Deferred@2070653245 after retry RPC after error@2056500165) -> (continuation of Deferred@1787148977 after retry RPC after error@1896360989) -> (continuation of Deferred@1460425024 after retry RPC after error@812047871) -> (continuation of Deferred@2003937648 after retry RPC after error@1202264903) -> (continuation of Deferred@1922745507 after retry RPC after error@1955952170) -> (continuation of Deferred@248867809 after retry RPC after error@27867743) -> (continuation of Deferred@624056597 after retry RPC after error@2060017599) -> (continuation of Deferred@1608952164 after retry RPC after error@399842053) -> (continuation of Deferred@546837019 after retry RPC after error@270308624) -> (continuation of Deferred@2061218814 after retry RPC after error@1164542611) -> (continuation of Deferred@620845295 after retry RPC after error@1363275082) -> (continuation of Deferred@1990385887 after retry RPC after error@2136381826) -> (continuation of Deferred@1346334887 after retry RPC after error@239795287) -> (continuation of Deferred@1863274841 after retry RPC after error@610160563) -> (continuation of Deferred@265267671 after retry RPC after error@1455313981) -> (continuation of Deferred@1127105066 after retry RPC after error@358333995) -> (continuation of Deferred@1730686022 after retry RPC after error@1133744930)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.899 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:25:04.899 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:04.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
14:25:04.981 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:04.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:04.982 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:04.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.983 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.983 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.983 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.983 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.984 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:04.984 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29473), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [203ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] refreshing cache from master, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [345ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [346ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [463ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1464ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1902ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5081ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5082ms] too many traces: truncated at 100 traces, deferred=Deferred@1107873338(state=PENDING, result=null, callback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288), errback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288)))
14:25:04.985 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:04.985 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:04.985 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:04.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:04.985 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29473), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [203ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] refreshing cache from master, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [345ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [346ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [463ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1464ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1902ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5081ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5082ms] too many traces: truncated at 100 traces, deferred=Deferred@1107873338(state=PENDING, result=null, callback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288), errback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29473), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [203ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] refreshing cache from master, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [345ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [346ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [463ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1464ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1902ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5081ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5082ms] too many traces: truncated at 100 traces, deferred=Deferred@1107873338(state=PENDING, result=null, callback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288), errback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.986 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:04.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:04.987 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:04.991 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29473), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [203ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] refreshing cache from master, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [345ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [346ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [463ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1464ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1902ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5081ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5082ms] too many traces: truncated at 100 traces, deferred=Deferred@1107873338(state=PENDING, result=null, callback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288), errback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29473), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [163ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [203ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [203ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] refreshing cache from master, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [345ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [346ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [346ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [463ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1464ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1902ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [5081ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [5082ms] too many traces: truncated at 100 traces, deferred=Deferred@1107873338(state=PENDING, result=null, callback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288), errback=(continuation of Deferred@681889561 after retry RPC after error@1787054643) -> (continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:04.991 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:04.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
14:25:04.992 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
14:25:04.992 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:25:04.993 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
14:25:04.993 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:25:04.993 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
14:25:04.993 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
14:25:04.994 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:25:04.994 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
14:25:04.994 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:25:05.002 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.002 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.003 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.003 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.003 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.003 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.003 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.003 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.003 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.003 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.009 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:25:05.009 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
14:25:05.009 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:25:05.022 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.022 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.022 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.023 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.023 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.023 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.023 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.026 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:25:05.027 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
14:25:05.027 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:25:05.035 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:25:05.035 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:25:05.036 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
14:25:05.037 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
14:25:05.037 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:05.041 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 77d052e6e51b5ae35525074f80512696
14:25:05.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114305041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:05.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.042 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.042 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.043 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.043 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.043 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.043 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.043 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.049 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:05.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:25:05.062 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.063 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.063 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.063 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.063 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.064 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.065 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.082 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.083 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.083 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.083 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.083 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.083 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.083 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.083 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:05.111 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.112 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.112 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.112 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.112 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.112 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.112 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.112 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.113 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.113 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.113 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.123893 18201 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.1:37201
14:25:05.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.124030 18370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.1:37201 every 8 connection(s)
14:25:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.127803 18201 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/data/info.pb
14:25:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.129906 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18201
14:25:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.130589 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-0/wal/instance
14:25:05.142 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.142 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.143 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.143 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.143 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.143 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.143 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.144 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.144 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.147691 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/logs
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data/info.pb
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.2:0
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.2
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.2
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:05.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:05.199 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:05.200 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:05.200 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:05.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.201 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.201 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.201 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:05.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.219357 18376 heartbeater.cc:344] Connected to a master server at 127.17.128.62:37019
14:25:05.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.219900 18376 heartbeater.cc:461] Registering TS with master...
14:25:05.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.221329 18376 heartbeater.cc:507] Master 127.17.128.62:37019 requested a full tablet report, sending...
14:25:05.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.225819 17965 ts_manager.cc:194] Registered new tserver with Master: 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201)
14:25:05.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.226949 18371 heartbeater.cc:344] Connected to a master server at 127.17.128.60:42293
14:25:05.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.227373 18371 heartbeater.cc:461] Registering TS with master...
14:25:05.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.228253 18371 heartbeater.cc:507] Master 127.17.128.60:42293 requested a full tablet report, sending...
14:25:05.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.228844 18372 heartbeater.cc:344] Connected to a master server at 127.17.128.61:34199
14:25:05.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.229189 18372 heartbeater.cc:461] Registering TS with master...
14:25:05.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.230120 18372 heartbeater.cc:507] Master 127.17.128.61:34199 requested a full tablet report, sending...
14:25:05.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.230967 18121 ts_manager.cc:194] Registered new tserver with Master: 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201)
14:25:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.232923 18041 ts_manager.cc:194] Registered new tserver with Master: 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201)
14:25:05.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.233806 18121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.128.1:37625
14:25:05.242 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.243 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.243 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.243 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.243 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.243 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.244 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.276 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:05.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:05.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:05.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.278 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.278 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.279 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:05.279 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29774), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [11ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [13ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [23ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [73ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [74ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [75ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [75ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [183ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [223ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [223ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [263ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [264ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [264ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [883ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [884ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1221ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1224ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2083ms] too many traces: truncated at 100 traces, deferred=Deferred@774942533(state=PENDING, result=null, callback=(continuation of Deferred@425189777 after retry RPC after error@1882370248) -> (continuation of Deferred@1700585548 after retry RPC after error@1312633125) -> (continuation of Deferred@1749031450 after retry RPC after error@219235114) -> (continuation of Deferred@256744516 after retry RPC after error@685650065) -> (continuation of Deferred@1084649306 after retry RPC after error@1193897079) -> (continuation of Deferred@619018090 after retry RPC after error@2103874015) -> (continuation of Deferred@239725974 after retry RPC after error@34566908) -> (continuation of Deferred@224267248 after retry RPC after error@1149209581) -> (continuation of Deferred@85715881 after retry RPC after error@2096820580) -> (continuation of Deferred@17196160 after retry RPC after error@958310318) -> (continuation of Deferred@1661093255 after retry RPC after error@1213786450) -> (continuation of Deferred@2051581629 after retry RPC after error@916938125) -> (continuation of Deferred@1207441571 after retry RPC after error@1214606199) -> (continuation of Deferred@1999065480 after retry RPC after error@2078286292) -> (continuation of Deferred@2094662411 after retry RPC after error@529002804) -> (continuation of Deferred@1382111325 after retry RPC after error@678767940) -> (continuation of Deferred@77312282 after retry RPC after error@607514348) -> (continuation of Deferred@2085546375 after retry RPC after error@2110846023) -> (continuation of Deferred@605723014 after retry RPC after error@793989479) -> (continuation of Deferred@609912795 after retry RPC after error@1582448091) -> (continuation of Deferred@779372862 after retry RPC after error@454684158) -> (continuation of Deferred@1804457241 after retry RPC after error@620663126) -> (continuation of Deferred@684659022 after retry RPC after error@2087550900) -> (continuation of Deferred@2043500605 after retry RPC after error@694747763) -> (continuation of Deferred@2038182769 after retry RPC after error@1853580085) -> (continuation of Deferred@2103759479 after retry RPC after error@486489394) -> (continuation of Deferred@67138151 after retry RPC after error@836225817) -> (continuation of Deferred@1786466366 after retry RPC after error@252241646) -> (continuation of Deferred@136068642 after retry RPC after error@119317307) -> (continuation of Deferred@928446790 after retry RPC after error@2132887252), errback=(continuation of Deferred@425189777 after retry RPC after error@1882370248) -> (continuation of Deferred@1700585548 after retry RPC after error@1312633125) -> (continuation of Deferred@1749031450 after retry RPC after error@219235114) -> (continuation of Deferred@256744516 after retry RPC after error@685650065) -> (continuation of Deferred@1084649306 after retry RPC after error@1193897079) -> (continuation of Deferred@619018090 after retry RPC after error@2103874015) -> (continuation of Deferred@239725974 after retry RPC after error@34566908) -> (continuation of Deferred@224267248 after retry RPC after error@1149209581) -> (continuation of Deferred@85715881 after retry RPC after error@2096820580) -> (continuation of Deferred@17196160 after retry RPC after error@958310318) -> (continuation of Deferred@1661093255 after retry RPC after error@1213786450) -> (continuation of Deferred@2051581629 after retry RPC after error@916938125) -> (continuation of Deferred@1207441571 after retry RPC after error@1214606199) -> (continuation of Deferred@1999065480 after retry RPC after error@2078286292) -> (continuation of Deferred@2094662411 after retry RPC after error@529002804) -> (continuation of Deferred@1382111325 after retry RPC after error@678767940) -> (continuation of Deferred@77312282 after retry RPC after error@607514348) -> (continuation of Deferred@2085546375 after retry RPC after error@2110846023) -> (continuation of Deferred@605723014 after retry RPC after error@793989479) -> (continuation of Deferred@609912795 after retry RPC after error@1582448091) -> (continuation of Deferred@779372862 after retry RPC after error@454684158) -> (continuation of Deferred@1804457241 after retry RPC after error@620663126) -> (continuation of Deferred@684659022 after retry RPC after error@2087550900) -> (continuation of Deferred@2043500605 after retry RPC after error@694747763) -> (continuation of Deferred@2038182769 after retry RPC after error@1853580085) -> (continuation of Deferred@2103759479 after retry RPC after error@486489394) -> (continuation of Deferred@67138151 after retry RPC after error@836225817) -> (continuation of Deferred@1786466366 after retry RPC after error@252241646) -> (continuation of Deferred@136068642 after retry RPC after error@119317307) -> (continuation of Deferred@928446790 after retry RPC after error@2132887252)))
14:25:05.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.283 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.283 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.309 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:05.310 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:05.310 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:05.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:05.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:05.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:05.310 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:05.310 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:05.310 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:05.310 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:05.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:05.311 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:05.311 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:05.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:05.349 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:05.349 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:05.349 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:05.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.350 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.350 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:05.362 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:05.362 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:05.362 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:05.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:05.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.363 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.363 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:05.363 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.363 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:05.363 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:05.521 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:05.521 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:05.522 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:05.522 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.522 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.522 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.522 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.522 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.522 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.523 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.523 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.523 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.523 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:05.524 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27695), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [7ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [7ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [23ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [43ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [383ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1042ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2780ms] refreshing cache from master, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2782ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2782ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5069ms] refreshing cache from master, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5070ms] too many traces: truncated at 100 traces, deferred=Deferred@1461704157(state=PENDING, result=null, callback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963), errback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963)))
14:25:05.525 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:05.525 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27695), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [7ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [7ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [23ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [43ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [383ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1042ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2780ms] refreshing cache from master, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2782ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2782ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5069ms] refreshing cache from master, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5070ms] too many traces: truncated at 100 traces, deferred=Deferred@1461704157(state=PENDING, result=null, callback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963), errback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:05.526 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
14:25:05.528 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
14:25:05.530 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27695), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [7ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [7ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [23ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [43ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [383ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [383ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [403ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [403ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1042ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2780ms] refreshing cache from master, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2782ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2782ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5069ms] refreshing cache from master, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5070ms] too many traces: truncated at 100 traces, deferred=Deferred@1461704157(state=PENDING, result=null, callback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963), errback=(continuation of Deferred@1558117303 after retry RPC after error@1413764380) -> (continuation of Deferred@1676541226 after retry RPC after error@1257602487) -> (continuation of Deferred@1641882653 after retry RPC after error@390553999) -> (continuation of Deferred@458218208 after retry RPC after error@2050364667) -> (continuation of Deferred@1925397100 after retry RPC after error@1579447970) -> (continuation of Deferred@995704668 after retry RPC after error@1904375040) -> (continuation of Deferred@444145926 after retry RPC after error@1737872781) -> (continuation of Deferred@356820476 after retry RPC after error@2005727265) -> (continuation of Deferred@607028935 after retry RPC after error@1843267186) -> (continuation of Deferred@1569011056 after retry RPC after error@1297650449) -> (continuation of Deferred@487603395 after retry RPC after error@14697605) -> (continuation of Deferred@1950015324 after retry RPC after error@2104695505) -> (continuation of Deferred@1629079448 after retry RPC after error@1675588434) -> (continuation of Deferred@1094553674 after retry RPC after error@612220718) -> (continuation of Deferred@192387390 after retry RPC after error@321535713) -> (continuation of Deferred@1052263182 after retry RPC after error@2012548920) -> (continuation of Deferred@1090307729 after retry RPC after error@40052057) -> (continuation of Deferred@2118104616 after retry RPC after error@569174552) -> (continuation of Deferred@125991162 after retry RPC after error@483450046) -> (continuation of Deferred@526231546 after retry RPC after error@1495740963)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:05.531 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:05.531 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
14:25:05.531 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
14:25:05.532 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:25:05.541 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114305541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:05.550 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:25:05.550 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:25:05.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.583971 18375 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:05.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.584635 18375 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:05.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.585358 18375 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:05.604 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:05.605 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:05.605 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:05.605 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.605 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.605 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.605 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.606 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:05.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:05.623 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:05.623 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:05.623 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:05.623 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.623 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.623 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:05.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.624 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:05.624 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.624 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.624 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:05.624 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:05.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.640255 18375 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:05.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.641528 18375 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.128.2
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.702884 18375 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.2:0
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data/info.pb
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.2
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.2
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/logs
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:05.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.704559 18375 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:05.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:05.706756 18375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:05.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.722229 18387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:05.855 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:05.855 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:05.855 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:05.856 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.856 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.856 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:05.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.856 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:05.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:05.856 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:05.891 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.892 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.892 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.892 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.893 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.893 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.893 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.893 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.893 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.893 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.893 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.893 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.894 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28050), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [7ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [43ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [66ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [82ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@771308800(state=PENDING, result=null, callback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095), errback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095)))
14:25:05.895 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.895 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.895 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.896 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28050), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [7ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [43ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [66ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [82ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@771308800(state=PENDING, result=null, callback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095), errback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28050), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [7ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [43ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [66ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [82ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@771308800(state=PENDING, result=null, callback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095), errback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:05.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.898 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.911 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.911 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.912 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.912 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.912 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.912 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.912 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.913 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.913 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.913 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.913 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.931 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.932 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.939 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28050), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [7ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [43ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [66ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [82ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@771308800(state=PENDING, result=null, callback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095), errback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28050), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [7ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [7ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [36ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [43ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [66ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [82ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [82ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [101ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@771308800(state=PENDING, result=null, callback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095), errback=(continuation of Deferred@258011163 after retry RPC after error@520587710) -> (continuation of Deferred@991158 after retry RPC after error@1694114698) -> (continuation of Deferred@1821566758 after retry RPC after error@1333512563) -> (continuation of Deferred@930192773 after retry RPC after error@35790482) -> (continuation of Deferred@2045927975 after retry RPC after error@1750273083) -> (continuation of Deferred@1408579841 after retry RPC after error@1093761891) -> (continuation of Deferred@725146168 after retry RPC after error@1534736816) -> (continuation of Deferred@557661935 after retry RPC after error@1805497288) -> (continuation of Deferred@110710169 after retry RPC after error@212095811) -> (continuation of Deferred@1151786622 after retry RPC after error@1109604049) -> (continuation of Deferred@244993673 after retry RPC after error@545929810) -> (continuation of Deferred@1378698515 after retry RPC after error@165901369) -> (continuation of Deferred@1439796618 after retry RPC after error@620262856) -> (continuation of Deferred@474327449 after retry RPC after error@244663444) -> (continuation of Deferred@1475421457 after retry RPC after error@809524242) -> (continuation of Deferred@33043170 after retry RPC after error@636319661) -> (continuation of Deferred@2070546348 after retry RPC after error@1241015327) -> (continuation of Deferred@165093600 after retry RPC after error@1204383336) -> (continuation of Deferred@1823823450 after retry RPC after error@1726422863) -> (continuation of Deferred@1451750227 after retry RPC after error@1513188805) -> (continuation of Deferred@485549919 after retry RPC after error@1110675177) -> (continuation of Deferred@726134935 after retry RPC after error@2060054399) -> (continuation of Deferred@1628972390 after retry RPC after error@1065532266) -> (continuation of Deferred@727004997 after retry RPC after error@508729159) -> (continuation of Deferred@1044488958 after retry RPC after error@338823095)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:05.939 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:05.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
14:25:05.940 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
14:25:05.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
14:25:05.940 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:05.940 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
14:25:05.940 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:05.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:05.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
14:25:05.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:05.944 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
14:25:05.944 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
14:25:05.945 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
14:25:05.951 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.952 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.952 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.952 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.952 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.952 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.952 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.952 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.966 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
14:25:05.966 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
14:25:05.966 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
14:25:05.966 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
14:25:05.966 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
14:25:05.967 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:05.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:05.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:05.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:05.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:05.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:05.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:05.971 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:05.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:05.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:05.971 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:05.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.972 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:05.972 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.972 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.972 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:05.973 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:05.973 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:05.975 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:05.975 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
14:25:05.975 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
14:25:05.985 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
14:25:05.985 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
14:25:05.985 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
14:25:06.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:06.002 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
14:25:06.002 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
14:25:06.010 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
14:25:06.010 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
14:25:06.011 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
14:25:06.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.011 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.011 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
14:25:06.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.012 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:06.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.012 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:25:06.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.041 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114306041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:06.052 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:06.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:25:06.091 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.091 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.091 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.092 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.092 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.092 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.092 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.092 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.092 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.093 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.093 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.093 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.093 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:06.211 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.211 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.212 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.212 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.212 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.212 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.213 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.213 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.213 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.213 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.231 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.231 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.231 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.231 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.231 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.232 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.232 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.232 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.232 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.232 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.232 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.232 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.232 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:06.237774 18371 heartbeater.cc:499] Master 127.17.128.60:42293 was elected leader, sending a full tablet report...
14:25:06.242 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:06.242 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:06.242 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:06.243 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:06.243 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:06.243 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:06.243 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:06.243 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:06.243 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:06.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:06.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:06.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:06.244 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:06.435 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:06.435 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:06.435 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:06.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.436 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.437 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.437 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.437 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.437 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:06.437 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28594), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [6ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [26ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [31ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [32ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [32ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [43ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [66ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [66ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [107ms] refreshing cache from master, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [108ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [108ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [108ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [108ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [124ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [154ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [384ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [384ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [501ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [502ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2340ms] refreshing cache from master, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2343ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5680ms] refreshing cache from master, [5680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@1912987148(state=PENDING, result=null, callback=(continuation of Deferred@888465625 after retry RPC after error@1691314359) -> (continuation of Deferred@600946421 after retry RPC after error@2147019069) -> (continuation of Deferred@1817801787 after retry RPC after error@1934369751) -> (continuation of Deferred@1560560981 after retry RPC after error@1695411913) -> (continuation of Deferred@1112717055 after retry RPC after error@1351772153) -> (continuation of Deferred@792964691 after retry RPC after error@624060116) -> (continuation of Deferred@1921046979 after retry RPC after error@837731781) -> (continuation of Deferred@57525405 after retry RPC after error@895424226) -> (continuation of Deferred@1105563467 after retry RPC after error@107129439) -> (continuation of Deferred@1808191266 after retry RPC after error@644037822) -> (continuation of Deferred@1267818734 after retry RPC after error@1488067473) -> (continuation of Deferred@97542266 after retry RPC after error@988359346) -> (continuation of Deferred@2050997009 after retry RPC after error@840522068) -> (continuation of Deferred@877407453 after retry RPC after error@1191390300) -> (continuation of Deferred@1088675998 after retry RPC after error@944296495) -> (continuation of Deferred@1832332095 after retry RPC after error@864590601) -> (continuation of Deferred@1823501046 after retry RPC after error@311887077) -> (continuation of Deferred@1185790811 after retry RPC after error@831139924) -> (continuation of Deferred@1577192265 after retry RPC after error@1947769920) -> (continuation of Deferred@1598330619 after retry RPC after error@1059853783) -> (continuation of Deferred@1899632952 after retry RPC after error@1106272707) -> (continuation of Deferred@989381704 after retry RPC after error@1705372781), errback=(continuation of Deferred@888465625 after retry RPC after error@1691314359) -> (continuation of Deferred@600946421 after retry RPC after error@2147019069) -> (continuation of Deferred@1817801787 after retry RPC after error@1934369751) -> (continuation of Deferred@1560560981 after retry RPC after error@1695411913) -> (continuation of Deferred@1112717055 after retry RPC after error@1351772153) -> (continuation of Deferred@792964691 after retry RPC after error@624060116) -> (continuation of Deferred@1921046979 after retry RPC after error@837731781) -> (continuation of Deferred@57525405 after retry RPC after error@895424226) -> (continuation of Deferred@1105563467 after retry RPC after error@107129439) -> (continuation of Deferred@1808191266 after retry RPC after error@644037822) -> (continuation of Deferred@1267818734 after retry RPC after error@1488067473) -> (continuation of Deferred@97542266 after retry RPC after error@988359346) -> (continuation of Deferred@2050997009 after retry RPC after error@840522068) -> (continuation of Deferred@877407453 after retry RPC after error@1191390300) -> (continuation of Deferred@1088675998 after retry RPC after error@944296495) -> (continuation of Deferred@1832332095 after retry RPC after error@864590601) -> (continuation of Deferred@1823501046 after retry RPC after error@311887077) -> (continuation of Deferred@1185790811 after retry RPC after error@831139924) -> (continuation of Deferred@1577192265 after retry RPC after error@1947769920) -> (continuation of Deferred@1598330619 after retry RPC after error@1059853783) -> (continuation of Deferred@1899632952 after retry RPC after error@1106272707) -> (continuation of Deferred@989381704 after retry RPC after error@1705372781)))
14:25:06.505 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:06.505 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:06.506 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:06.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.507 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.507 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.507 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.507 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.508 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.508 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.508 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:06.508 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28669), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [8ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [10ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [27ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [34ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [35ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [44ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [62ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [164ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [165ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [165ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [166ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [166ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [203ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [443ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [443ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [823ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [824ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [827ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [827ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1622ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2801ms] refreshing cache from master, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2802ms] too many traces: truncated at 100 traces, deferred=Deferred@389383079(state=PENDING, result=null, callback=(continuation of Deferred@2110621992 after retry RPC after error@1824992827) -> (continuation of Deferred@420853736 after retry RPC after error@579221462) -> (continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184), errback=(continuation of Deferred@2110621992 after retry RPC after error@1824992827) -> (continuation of Deferred@420853736 after retry RPC after error@579221462) -> (continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184)))
14:25:06.531 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.531 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.531 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.532 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.532 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.532 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.532 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.532 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.532 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.532 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114306541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:06.553 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:25:06.554 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:25:06.612 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:06.612 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:06.612 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:06.612 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:06.612 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.612 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:06.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:06.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:06.613 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:06.752 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:06.752 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:06.752 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:06.753 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:06.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:06.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:06.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:06.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:06.753 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:06.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:06.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:06.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:06.754 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:06.905 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:06.906 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:06.906 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:06.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.907 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.907 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:06.908 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.908 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.908 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:06.908 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.908 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.908 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:06.908 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:06.909 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29086), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [7ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [7ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [25ms] refreshing cache from master, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [32ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [39ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [41ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [70ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [87ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [87ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [87ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [142ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [142ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [171ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [171ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [172ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [204ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [242ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [542ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [542ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [543ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [543ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1443ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2582ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5201ms] refreshing cache from master, [5201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@1886423519(state=PENDING, result=null, callback=(continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223) -> (continuation of Deferred@1395328984 after retry RPC after error@1554863064) -> (continuation of Deferred@2141216740 after retry RPC after error@1356592319), errback=(continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223) -> (continuation of Deferred@1395328984 after retry RPC after error@1554863064) -> (continuation of Deferred@2141216740 after retry RPC after error@1356592319)))
14:25:07.030 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:07.030 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:07.030 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:07.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:07.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:07.031 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:07.030 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:07.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:07.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:07.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:07.031 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:07.031 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:07.031 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:07.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114307041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:07.053 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:07.054 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:07.054 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:07.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:07.054 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:07.054 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:07.054 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:07.054 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:07.054 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:07.054 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:07.054 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:07.054 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:07.055 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:07.058 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:25:07.059 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:25:07.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:07.193 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:25:07.194 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:25:07.195 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:25:07.195 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:07.196 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
14:25:07.198 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:07.199 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
14:25:07.199 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:25:07.199 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:25:07.201 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:25:07.202 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
14:25:07.202 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
14:25:07.203 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3ae13d08
14:25:07.203 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:07.204 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:07.204 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:25:07.206 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
14:25:07.207 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c0a7716
14:25:07.212 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:07.213 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
14:25:07.213 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:25:07.214 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:25:07.215 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:25:07.217 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
14:25:07.218 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:07.218 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:07.221 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
14:25:07.221 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:25:07.222 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
14:25:07.224 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:07.224 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
14:25:07.225 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:25:07.225 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:25:07.227 [INFO - Thread-41] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:07.228 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state TERMINATED
14:25:07.228 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state TERMINATED
14:25:07.228 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state TERMINATED
14:25:07.229 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:07.230 [INFO - Thread-41] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:07.230 [INFO - Thread-41] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:07.232 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:25:07.234 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:25:07.236 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.240 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
14:25:07.240 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
14:25:07.240 [DEBUG - Thread-41] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:07.241 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20df94a5
14:25:07.241 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:07.241 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:07.241 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:25:07.242 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:25:07.242 [INFO - Thread-41] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:07.251 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@783701dc
14:25:07.253 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:07.253 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:25:07.254 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.254 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:25:07.255 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
14:25:07.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.255 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
14:25:07.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5771f6e
14:25:07.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:07.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:07.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:25:07.257 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:25:07.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.259 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.263 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c880238
14:25:07.265 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:07.266 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:07.266 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:07.266 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:07.266 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:07.277 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.279 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.280 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.283 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.283 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.283 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.283 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.285 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.286 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.287 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.287 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.287 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
14:25:07.287 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
14:25:07.288 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.288 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.289 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45ab2eb0
14:25:07.289 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:07.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.289 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:07.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.289 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:25:07.289 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:25:07.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.290 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.290 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.290 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.291 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.291 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.291 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.291 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.293 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.293 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.294 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.295 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.295 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.296 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.297 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.297 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.298 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.298 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.298 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.298 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.298 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.298 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.298 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.300 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5d277c08
14:25:07.302 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:07.306 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.307 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.308 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.308 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.309 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.310 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.312 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.316 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.316 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.317 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.317 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.317 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.317 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.317 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.317 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.317 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.318 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.318 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.318 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.318 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.320 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.320 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.320 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.320 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.321 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.322 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.322 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.322 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.324 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.326 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.326 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.326 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.326 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.326 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.326 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.327 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.327 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.327 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.328 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.329 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.331 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.332 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.332 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.332 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.335 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.336 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.337 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.337 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.337 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.338 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.338 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.338 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.338 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.338 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.338 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.338 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.338 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.339 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.339 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.339 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.339 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.339 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.339 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.345 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.345 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.347 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.347 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.347 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.347 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.348 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.348 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.348 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.348 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.348 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.348 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.349 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.350 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.351 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.351 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.352 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.358 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.359 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.362 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.363 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.366 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.366 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.367 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.367 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.367 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.367 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.367 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.367 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.367 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.367 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.367 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.367 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.367 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.368 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.368 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.368 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.369 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.369 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.369 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.369 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.376 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.377 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.377 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.377 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.377 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.377 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.378 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.380 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.382 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.382 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.384 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.386 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.386 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.386 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.386 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.386 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.387 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.387 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.387 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.387 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.387 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.388 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.388 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.389 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.389 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.389 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.389 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.389 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.389 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.389 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.389 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.391 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.391 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.391 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.395 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.395 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.395 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.401 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.401 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.401 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.401 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.401 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.401 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.401 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.401 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.407 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.407 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.407 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.408 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.408 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.408 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.408 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.408 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.408 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.408 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.409 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.409 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.409 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.409 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.409 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.409 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.409 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.409 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.410 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.410 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.410 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.410 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.410 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.411 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.411 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.428 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.428 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.428 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.428 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.428 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.428 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.429 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.429 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.429 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.429 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.429 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.429 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.429 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.430 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.430 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.430 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.431 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.431 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.431 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.431 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.436 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.437 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.437 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.437 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.437 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.437 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.438 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.438 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.438 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.438 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.438 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.447 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.447 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.447 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.448 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.448 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.448 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.448 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.448 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.448 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.449 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.449 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.449 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.457 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.467 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.467 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.468 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.468 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.468 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.468 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.468 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.468 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.469 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.469 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.469 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.469 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.468 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.468 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.469 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.469 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.469 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.469 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.477 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.477 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.477 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.477 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.478 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.478 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.478 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.478 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.478 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.478 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.478 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.488 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.488 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.488 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.489 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.489 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.489 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.489 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.489 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.490 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.508 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.508 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.509 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.509 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.509 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.509 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.509 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.509 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.509 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.509 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114307541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:07.548 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.548 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.550 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.551 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.549 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:07.552 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:25:07.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.553 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.553 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:07.567 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.568 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.568 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.568 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.568 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.568 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.569 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.569 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.569 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.569 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.589 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.589 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.589 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.590 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.590 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.590 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.590 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.606 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.607 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.607 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.607 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.607 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.607 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.608 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.608 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.608 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.608 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.608 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.608 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.608 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.609 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.608 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.609 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.609 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:07.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:07.140833 18386 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 18375
14:25:07.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:07.616127 18375 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.893s	user 0.614s	sys 1.138s
14:25:07.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:07.616791 18375 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.893s	user 0.614s	sys 1.138s
14:25:07.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:05.724112 18388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:07.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:07.618117 18389 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1892 milliseconds
14:25:07.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.618423 18375 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:07.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:07.618515 18390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:07.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.622260 18375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:07.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.624375 18375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:07.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.625733 18375 hybrid_clock.cc:648] HybridClock initialized: now 1779114307625688 us; error 40 us; skew 500 ppm
14:25:07.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.626704 18375 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:07.628 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.629 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.629 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.630 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.634359 18375 webserver.cc:533] Webserver started at http://127.17.128.2:42543/ using document root <none> and password file <none>
14:25:07.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.635452 18375 fs_manager.cc:362] Metadata directory not provided
14:25:07.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.635687 18375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:07.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.636230 18375 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:07.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.640821 18375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data/instance:
14:25:07.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:07.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:07 on dist-test-slave-1n46"
14:25:07.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.642089 18375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal/instance:
14:25:07.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:07.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:07 on dist-test-slave-1n46"
14:25:07.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.650079 18375 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:25:07.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.655654 18460 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:07.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.656725 18375 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.657049 18375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:07 on dist-test-slave-1n46"
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.657413 18375 fs_report.cc:389] FS layout report
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data/data
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:07.687 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.688 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.688 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.688 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:07.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.713397 18375 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:07.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.714685 18375 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:07.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.715056 18375 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:07.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.717758 18375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:07.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.722064 18375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:07.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.722249 18375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:07.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.722411 18375 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:07.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.722599 18375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:07.771 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:07.772 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:07.772 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:07.772 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:07.772 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:07.772 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:07.772 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:07.772 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:07.773 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:07.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:07.773 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:07.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:07.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:07.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:07.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:07.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:07.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:07.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:07.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:07.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:07.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:07.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:07.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:07.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:07.773 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:07.774 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:07.788 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.788 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.789 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.789 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.789 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.789 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.790 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.790 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.863674 18375 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.2:44563
14:25:07.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.863757 18572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.2:44563 every 8 connection(s)
14:25:07.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.866168 18375 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/data/info.pb
14:25:07.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.873508 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18375
14:25:07.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.874008 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-1/wal/instance
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.887895 17920 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/logs
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data/info.pb
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.3:0
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.3
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.3
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:07.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:07.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.923518 18575 heartbeater.cc:344] Connected to a master server at 127.17.128.62:37019
14:25:07.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.923990 18575 heartbeater.cc:461] Registering TS with master...
14:25:07.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.924621 18574 heartbeater.cc:344] Connected to a master server at 127.17.128.61:34199
14:25:07.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.924948 18574 heartbeater.cc:461] Registering TS with master...
14:25:07.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.925179 18575 heartbeater.cc:507] Master 127.17.128.62:37019 requested a full tablet report, sending...
14:25:07.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.926290 18574 heartbeater.cc:507] Master 127.17.128.61:34199 requested a full tablet report, sending...
14:25:07.927 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.928 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.928 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.928 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.928 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.928 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.928 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.929 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.928974 17965 ts_manager.cc:194] Registered new tserver with Master: c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563)
14:25:07.929 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.929 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.931089 18041 ts_manager.cc:194] Registered new tserver with Master: c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563)
14:25:07.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.931841 18573 heartbeater.cc:344] Connected to a master server at 127.17.128.60:42293
14:25:07.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.932209 18573 heartbeater.cc:461] Registering TS with master...
14:25:07.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.933029 18573 heartbeater.cc:507] Master 127.17.128.60:42293 requested a full tablet report, sending...
14:25:07.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.934744 18121 ts_manager.cc:194] Registered new tserver with Master: c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563)
14:25:07.940 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:07.940 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:07.940 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:07.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:07.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:07.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:07.941 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:07.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:07.936158 18121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.128.2:37207
14:25:07.967 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:07.968 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:07.968 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:07.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.968 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.968 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:07.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:07.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:07.968 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:08.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114308041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:08.047 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.047 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.048 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.048 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.049 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.049 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.049 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.049 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.049 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.049 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.049 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.050 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.050 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.050 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.050 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:08.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:25:08.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:08.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:08.223 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:08.223 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:08.223 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:08.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.223 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.223 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.223 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.223 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.224 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.224 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:08.227 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.227 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.227 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.228 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.234 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:08.234 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:08.234 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:08.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.235 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.235 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.235 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.235 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.235 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.235 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:08.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.236470 18583 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:08.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.236950 18583 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:08.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.237385 18583 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:08.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.271831 18583 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:08.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.272739 18583 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.128.3
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:08.308964 18583 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.128.20:37311
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.128.3:0
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data/info.pb
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.128.3
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.128.3
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/logs
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:08.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:08.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:08.310379 18583 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:08.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:08.311949 18583 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.324379 18589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:08.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:08.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:08.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:08.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:08.409 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:08.409 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:08.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:08.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:08.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:08.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:08.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:08.410 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:08.410 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:08.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.457 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.479 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:08.480 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:08.480 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:08.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.480 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.480 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.481 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:08.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114308541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:08.550 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:08.550 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:08.550 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:08.551 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:08.551 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:08.551 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:08.551 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:08.551 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:08.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:08.552 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:08.552 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:08.552 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:08.552 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:08.556 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:25:08.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:08.560 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:25:08.612 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:08.636 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.637 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.637 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.638 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.638 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.639 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.639 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.639 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.639 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.709 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:08.709 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:08.709 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:08.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:08.711 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:08.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.711 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:08.711 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:08.874 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:08.875 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:08.875 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:08.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:08.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:08.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:08.877 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:08.944486 18573 heartbeater.cc:499] Master 127.17.128.60:42293 was elected leader, sending a full tablet report...
14:25:09.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114309042 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:09.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:09.065 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=20 ms, finalizationTime=3 ms).
14:25:09.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:25:09.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:09.170 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:09.170 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:09.170 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:09.171 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.171 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.172 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.173 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:09.219 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:09.219 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:09.219 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:09.220 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.220 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.220 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.222 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:09.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114309541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:09.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:09.558 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:25:09.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:25:09.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:09.648 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:09.649 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:09.649 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:09.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.649 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.649 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.649 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.649 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.650 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.650 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.650 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:09.728969 18588 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 18583
14:25:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:09.736086 18583 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.411s	user 0.442s	sys 0.892s
14:25:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:09.736534 18583 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.412s	user 0.442s	sys 0.892s
14:25:09.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:08.324968 18590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:09.738636 18592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:09.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:09.741814 18591 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1411 milliseconds
14:25:09.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.741883 18583 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:09.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.743072 18583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:09.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.745761 18583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.747205 18583 hybrid_clock.cc:648] HybridClock initialized: now 1779114309747099 us; error 106 us; skew 500 ppm
14:25:09.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.748090 18583 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:09.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.754230 18583 webserver.cc:533] Webserver started at http://127.17.128.3:43443/ using document root <none> and password file <none>
14:25:09.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.755201 18583 fs_manager.cc:362] Metadata directory not provided
14:25:09.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.755445 18583 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:09.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.755995 18583 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:09.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.760457 18583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data/instance:
14:25:09.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:09.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:09 on dist-test-slave-1n46"
14:25:09.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.761678 18583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal/instance:
14:25:09.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:09.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:09 on dist-test-slave-1n46"
14:25:09.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.768533 18583 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:25:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.774077 18600 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.775053 18583 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
14:25:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.775389 18583 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal
14:25:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:09 on dist-test-slave-1n46"
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.775766 18583 fs_report.cc:389] FS layout report
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data/data
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:09.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.829492 18583 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:09.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.830971 18583 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:09.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.831423 18583 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:09.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.833894 18583 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:09.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.838223 18583 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:09.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.838487 18583 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:09.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.838873 18583 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:09.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:09.839038 18583 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:09.868 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:09.868 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:09.869 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:09.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:09.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:09.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:09.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:09.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:09.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:09.870 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:09.870 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:09.870 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:09.870 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:09.927 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:09.927 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:09.927 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:09.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:09.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.928 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.928 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:09.928 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:09.928 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:10.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.005136 18583 rpc_server.cc:307] RPC server started. Bound to: 127.17.128.3:42479
14:25:10.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.005290 18712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.128.3:42479 every 8 connection(s)
14:25:10.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.007779 18583 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/data/info.pb
14:25:10.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.013214 17920 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18583
14:25:10.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.013823 17920 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster88138800118841409/ts-2/wal/instance
14:25:10.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114310041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:10.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.049877 18715 heartbeater.cc:344] Connected to a master server at 127.17.128.62:37019
14:25:10.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.050446 18715 heartbeater.cc:461] Registering TS with master...
14:25:10.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.051713 18715 heartbeater.cc:507] Master 127.17.128.62:37019 requested a full tablet report, sending...
14:25:10.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.051949 18714 heartbeater.cc:344] Connected to a master server at 127.17.128.61:34199
14:25:10.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.052300 18714 heartbeater.cc:461] Registering TS with master...
14:25:10.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.053201 18714 heartbeater.cc:507] Master 127.17.128.61:34199 requested a full tablet report, sending...
14:25:10.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.054901 17965 ts_manager.cc:194] Registered new tserver with Master: 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:10.056 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:25:10.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.056635 18041 ts_manager.cc:194] Registered new tserver with Master: 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:10.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.057 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:25:10.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.061201 18713 heartbeater.cc:344] Connected to a master server at 127.17.128.60:42293
14:25:10.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.061486 18713 heartbeater.cc:461] Registering TS with master...
14:25:10.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.062315 18713 heartbeater.cc:507] Master 127.17.128.60:42293 requested a full tablet report, sending...
14:25:10.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.064435 18121 ts_manager.cc:194] Registered new tserver with Master: 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:10.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.065892 18121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.128.3:34319
14:25:10.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.071705 17920 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:25:10.083 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:10.083 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:25:10.084 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.17.128.62"
      port: 37019
    }
    bound_http_address {
      host: "127.17.128.62"
      port: 43075
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.17.128.61"
      port: 34199
    }
    bound_http_address {
      host: "127.17.128.61"
      port: 33223
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.17.128.60"
      port: 42293
    }
    bound_http_address {
      host: "127.17.128.60"
      port: 38095
    }
  }
}

14:25:10.084 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:25:10.085 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.17.128.1"
      port: 37201
    }
    bound_http_address {
      host: "127.17.128.1"
      port: 40713
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.17.128.2"
      port: 44563
    }
    bound_http_address {
      host: "127.17.128.2"
      port: 42543
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.17.128.3"
      port: 42479
    }
    bound_http_address {
      host: "127.17.128.3"
      port: 43443
    }
  }
}

14:25:10.085 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:25:10.087 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.087 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:25:10.088 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:25:10.088 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:25:10.088 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:25:10.096 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:25:10.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.200 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:10.200 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:10.200 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:10.200 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.200 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.201 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.201 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.201 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:10.229 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:25:10.230 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:25:10.231 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:25:10.231 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:10.232 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
14:25:10.232 [INFO - Thread-43] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:10.232 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:25:10.232 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:25:10.232 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:25:10.232 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:10.233 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
14:25:10.233 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:25:10.233 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:10.233 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
14:25:10.233 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:25:10.234 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:10.234 [INFO - Thread-43] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:10.234 [INFO - Thread-43] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:10.234 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:25:10.234 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
14:25:10.234 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:25:10.235 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
14:25:10.235 [DEBUG - Thread-43] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.235 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:25:10.236 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
14:25:10.236 [INFO - Thread-43] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:10.236 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
14:25:10.236 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:25:10.236 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
14:25:10.237 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:10.237 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:10.237 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:10.237 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:10.237 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
14:25:10.237 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:25:10.237 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:10.237 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:25:10.237 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:10.238 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.239 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.239 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
14:25:10.239 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.239 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50adfdf8
14:25:10.240 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:10.240 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.240 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:10.240 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:25:10.240 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:25:10.242 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@72866c5c
14:25:10.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:10.242952 18569 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad0e0 after lost signal to thread 18382
14:25:10.243 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.244 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:25:10.244 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
14:25:10.244 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
14:25:10.244 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e98319
14:25:10.244 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:10.244 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:10.244 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:25:10.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:10.244107 18569 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5600 after lost signal to thread 18572
14:25:10.245 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:25:10.245 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:25:10.246 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66adec39
14:25:10.248 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.248 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.249 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.249 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.249 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.250 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.251 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:25:10.252 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:25:10.252 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
14:25:10.252 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
14:25:10.253 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e380c74
14:25:10.253 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:10.253 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:10.253 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:25:10.254 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:25:10.254 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16ceb087
14:25:10.258 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.258 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.262 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
14:25:10.262 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
14:25:10.262 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.263 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c1ae173
14:25:10.263 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.263 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:10.263 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:10.263 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:25:10.263 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:25:10.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.266 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@53cebbbb
14:25:10.270 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.271 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.273 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.273 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.273 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.274 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.274 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.275 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.275 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.279 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.282 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:10.283 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:10.283 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:10.283 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.283 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:10.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:10.287 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:10.287 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:10.287 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:10.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.298 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.298 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.298 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.299 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:10.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.299 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:10.299 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:10.299 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.299 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.299 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:10.299 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.299 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.299 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.300 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.302 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.306 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.306 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.307 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.308 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.308 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.308 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.308 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.309 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.310 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.310 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.314 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.314 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.314 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.314 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.315 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.315 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.316 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.316 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.317 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.317 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.318 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.318 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.318 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.318 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.319 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.319 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.319 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.319 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.319 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.319 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.319 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.320 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.322 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.323 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.323 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.323 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.324 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.325 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.325 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.325 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.325 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.325 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.325 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.325 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.326 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.333 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.334 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.334 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.334 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.334 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.335 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.335 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.336 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.336 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.336 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.340 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.343 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.343 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.343 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.343 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.344 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.344 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.344 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.344 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.344 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.344 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.344 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.344 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.345 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.345 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.345 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.345 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.345 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.354 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.354 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.354 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.354 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.355 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.355 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.355 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.355 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.355 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.355 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.355 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.356 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.356 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.356 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.356 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.356 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.362 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.362 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.362 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.363 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.363 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.363 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.363 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.363 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.363 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.364 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.364 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.364 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.364 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.364 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.374 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.374 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.374 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.374 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.375 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.375 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.375 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.375 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.376 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.376 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.379 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.379 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.379 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.379 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.379 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.379 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.379 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.379 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.379 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.380 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.383 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.383 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.383 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.383 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.383 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.383 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.383 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.383 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.384 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.384 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.384 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.384 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.384 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.384 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.385 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.385 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.403 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.403 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.404 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:10.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:10.408 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:10.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:10.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:10.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:10.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:10.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:10.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:10.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:10.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:10.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:10.410 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:10.414 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.414 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.414 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.414 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.415 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.415 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.415 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.416 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.416 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.433 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:10.433 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:10.433 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:10.433 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:10.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:10.433 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:10.433 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:10.433 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:10.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:10.434 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:10.434 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:10.434 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:10.434 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:10.435 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.435 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.435 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.435 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.436 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.439 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.439 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.439 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.439 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.439 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.439 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.439 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.440 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.440 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.440 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.443 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.443 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.443 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.444 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.444 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.444 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.444 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.454 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.454 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.454 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.462 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.463 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.463 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.463 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.463 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.463 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.464 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.464 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.473 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.473 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.473 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.474 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.474 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.474 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.484 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.502 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.502 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.503 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.503 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.503 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.503 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.502 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.504 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.504 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.504 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.504 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.504 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.504 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.504 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.504 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.505 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.505 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.505 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114310541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:10.554 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.555 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.555 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.556 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.556 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.556 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.556 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.558 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:25:10.558 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:25:10.559 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.559 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.559 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.559 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.559 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.559 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.560 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.560 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.560 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.560 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.560 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.560 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.583 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:10.583 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:25:10.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.588778 18723 mini_oidc.cc:150] Starting JWKS server
14:25:10.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.593462 18723 webserver.cc:533] Webserver started at http://127.0.0.1:39783/ using document root <none> and password file <none>
14:25:10.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.594008 18723 mini_oidc.cc:186] Starting OIDC Discovery server
14:25:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.596362 18723 webserver.cc:533] Webserver started at http://127.0.0.1:38817/ using document root <none> and password file <none>
14:25:10.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:25:10.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:10Z Disabled control of system clock
14:25:10.675 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.675 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.675 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.676 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.676 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.676 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:10.689698 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/logs
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data/info.pb
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.254:35143
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.254
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:10.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:10.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:10.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:10.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:10.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json with env {}
14:25:10.733 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.734 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.734 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.735 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.735 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.736 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:10.736 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:10.736 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:10.737 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.737 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.737 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.738 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.738 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:10.747 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:10.747 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:10.747 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:10.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:10.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:10.749 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:10.749 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:10.762 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.763 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.763 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.763 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.763 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.764 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:10.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:10.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:10.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.819 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.819 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.819 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:10.819 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.819 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:10.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:10.820 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:10.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:10.923 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.924 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.924 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.925 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:10.974 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:10.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:10.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:10.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.975 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.975 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.975 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:10.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:10.975 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:10.976 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114311041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:11.049 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:11.050 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:25:11.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:11.069476 18713 heartbeater.cc:499] Master 127.17.128.60:42293 was elected leader, sending a full tablet report...
14:25:11.083 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.083 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.083 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.083 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.083 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.083 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.083 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.084 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.084 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.104790 18788 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:11.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.105510 18788 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:11.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.106256 18788 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:11.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.147133 18788 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.147398 18788 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.147611 18788 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.147997 18788 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.148308 18788 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.148557 18788 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39783/jwks.json
14:25:11.153 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.153 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.153 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.154 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.154 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.154 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.154 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.154 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:11.187141 18788 master_runner.cc:387] Master server non-default flags:
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.254:35143
14:25:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data/info.pb
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.254
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/logs
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:11.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:11.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:11.188778 18788 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:11.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:11.190552 18788 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:11.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.202824 18794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:11.299 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:11.300 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:11.300 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:11.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:11.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:11.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:11.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:11.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:11.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:11.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:11.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:11.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:11.302 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:11.352 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:11.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:11.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:11.353 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:11.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:11.353 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:11.354 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:11.354 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:11.354 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:11.354 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:11.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:11.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:11.354 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:11.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.474 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:11.474 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:11.474 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:11.475 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.475 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.475 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.476 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:11.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.536 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.536 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.536 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.536 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.536 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.537 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.537 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114311541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:11.550 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:11.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:25:11.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.674 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:11.675 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:11.675 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:11.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.675 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.676 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.676 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:11.736 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:11.737 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:11.737 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:11.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:11.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:11.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:11.738 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:11.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:11.739 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:11.739 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:11.739 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:11.739 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:11.739 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:11.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.844 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.844 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.844 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.845 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.859 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:11.860 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:11.860 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:11.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:11.860 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.860 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.861 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:11.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:11.861 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:11.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:11.883 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.883 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.884 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.885 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.885 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.885 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.886 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:11.935 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:11.935 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:11.935 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:11.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:11.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:11.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:11.936 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.015 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:12.015 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:12.015 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:12.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.017 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.023 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:12.023 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:12.023 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:12.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.024 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:12.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114312041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:12.050 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:25:12.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:25:12.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.134 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:12.134 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:12.134 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:12.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.136 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.158 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:12.159 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:12.159 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:12.162 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:12.162 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:12.162 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:12.162 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:12.162 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:12.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:12.163 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:12.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:12.163 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:12.163 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:12.232 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:12.232 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:12.233 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:12.233 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:12.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:12.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:12.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:12.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:12.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:12.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:12.234 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:12.234 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:12.234 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:12.240 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:12.240 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:12.240 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:12.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.241 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:12.256 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:12.256 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:12.257 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:12.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.258 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.258 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.258 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.258 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:12.263 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:12.264 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:12.264 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:12.264 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.265 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:12.309 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:12.309 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:12.309 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:12.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.310 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:12.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.454 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:12.454 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:12.454 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:12.454 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:12.454 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:12.455 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:12.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.455 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:12.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:12.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:12.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:12.462 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:12.462 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:12.462 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:12.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.463 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.464 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.464 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.464 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.466 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:12.467 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:12.467 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:12.467 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.467 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.467 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.468 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.468 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.468 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.468 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.468 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.468 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.468 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:12.547 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114312546 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:12.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:12.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:12.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:12.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:12.548 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:12.548 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:12.549 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:12.549 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:12.549 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:12.549 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:12.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:12.549 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:12.549 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:12.567 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.571 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
14:25:12.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:25:12.603 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:12.603 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:12.604 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:12.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:12.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:12.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:12.607 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:12.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.626 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:12.627 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:12.627 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:12.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.628 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.628 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.628 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:12.650 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:12.650 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:12.650 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:12.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.651 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.652 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:12.709 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:12.709 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:12.710 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:12.710 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.710 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.710 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:12.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.711 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:12.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:12.711 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:12.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:12.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:12.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:12.969 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:12.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.970 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.970 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:12.971 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.971 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:12.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:12.971 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:13.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114313041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:13.056 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:25:13.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.057 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:25:13.075 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:13.075 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:13.075 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:13.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.076 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.076 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.077 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:13.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.155 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:13.155 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:13.155 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:13.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.156 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.157 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:13.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:12.609345 18793 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 18788
14:25:13.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.381510 18793 kernel_stack_watchdog.cc:198] Thread 18788 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 403ms:
14:25:13.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:13.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:13.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:13.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:13.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.381590 18788 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.178s	user 0.697s	sys 1.212s
14:25:13.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:11.203843 18795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:13.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.383370 18788 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.179s	user 0.698s	sys 1.212s
14:25:13.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.384093 18797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.387053 18796 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2178 milliseconds
14:25:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.387086 18788 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:13.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.388568 18788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:13.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.390805 18788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:13.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.392200 18788 hybrid_clock.cc:648] HybridClock initialized: now 1779114313392142 us; error 47 us; skew 500 ppm
14:25:13.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.392975 18788 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:13.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.399314 18788 webserver.cc:533] Webserver started at http://127.18.72.254:41715/ using document root <none> and password file <none>
14:25:13.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.400108 18788 fs_manager.cc:362] Metadata directory not provided
14:25:13.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.400336 18788 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:13.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.400758 18788 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:13.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.406633 18788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data/instance:
14:25:13.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0340fcb1c4a748f09ec9e553d81e5858"
14:25:13.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:13 on dist-test-slave-1n46"
14:25:13.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.407769 18788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal/instance:
14:25:13.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0340fcb1c4a748f09ec9e553d81e5858"
14:25:13.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:13 on dist-test-slave-1n46"
14:25:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.415230 18788 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
14:25:13.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.421237 18808 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.422345 18788 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
14:25:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.422667 18788 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal
14:25:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0340fcb1c4a748f09ec9e553d81e5858"
14:25:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:13 on dist-test-slave-1n46"
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.422941 18788 fs_report.cc:389] FS layout report
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data/data
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:13.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:13.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.472157 18788 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:13.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.473528 18788 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:13.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.474072 18788 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:13.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114313541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:13.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.550462 18788 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.254:35143
14:25:13.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.550503 18859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.254:35143 every 8 connection(s)
14:25:13.550 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:13.551 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:25:13.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.553462 18788 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/data/info.pb
14:25:13.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.558696 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18788
14:25:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.559128 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-0/wal/instance
14:25:13.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.559948 18860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.562382 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/logs
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data/info.pb
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.253:45261
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.253
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json with env {}
14:25:13.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.573869 18860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
14:25:13.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.605468 18860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } has no permanent_uuid. Determining permanent_uuid...
14:25:13.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.607990 18809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.612435 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.661836 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 1
14:25:13.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.666388 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.734805 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 2
14:25:13.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.738806 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.823 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:13.823 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:13.823 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:13.823 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:13.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:13.824 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:13.824 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:13.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.830123 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 3
14:25:13.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.834223 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.859 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:13.859 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:13.859 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:13.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:13.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:13.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:13.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:13.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:13.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:13.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:13.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:13.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:13.860 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:13.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:13.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.884770 18862 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:13.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.885376 18862 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:13.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.885823 18862 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:13.896 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:13.897 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:13.897 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:13.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:13.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:13.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:13.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:13.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:13.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:13.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:13.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:13.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:13.898 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:13.914 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:13.914 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:13.914 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:13.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.915 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.915 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:13.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.931823 18862 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:13.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.932199 18862 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:13.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.932504 18862 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:13.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.932780 18862 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.933063 18862 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.933271 18862 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39783/jwks.json
14:25:13.962 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:13.963 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:13.963 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:13.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:13.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:13.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:13.966 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:13.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.976581 18862 master_runner.cc:387] Master server non-default flags:
14:25:13.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.253:45261
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data/info.pb
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.253
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/logs
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:13.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:13.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.977624 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 4
14:25:13.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.978016 18862 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:13.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:13.979933 18862 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:13.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.981788 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:13.990 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:13.990 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:13.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:13.991 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:13.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:13.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:13.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:13.992 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:13.992 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:13.992 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.991920 18871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:13.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:13.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:13.992 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:14.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114314041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:14.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.058 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:25:14.063 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:25:14.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:14.281230 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 5
14:25:14.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:14.299458 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:14.308 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:14.308 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:14.309 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:14.309 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.309 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.309 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.309 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.310 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.311 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:14.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.388 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:14.389 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:14.389 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:14.390 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:14.390 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:14.390 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:14.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:14.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:14.391 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:14.391 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:14.391 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:14.391 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:14.391 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:14.492 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:14.493 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:14.493 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:14.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:14.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:14.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:14.495 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:14.495 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:14.495 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:14.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:14.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:14.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:14.496 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:14.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114314541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:14.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.557 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:25:14.559 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:25:14.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.688 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:14.688 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:14.689 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:14.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:14.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:14.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:14.690 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:14.693 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:14.693 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:14.694 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:14.694 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:14.694 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:14.694 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:14.694 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:14.694 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:14.694 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:14.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:14.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:14.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:14.695 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:14.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:14.847064 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 6
14:25:14.874 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:14.875 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:14.875 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:14.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:14.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:14.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:14.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:14.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:14.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:14.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:14.876 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:14.876 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:14.876 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:14.880 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:14.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:14.881402 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.253:45261: Network error: Client connection negotiation failed: client connection to 127.18.72.253:45261: connect: Connection refused (error 111)
14:25:15.024 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:15.024 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:15.024 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:15.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.025 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:15.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114315041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:15.055 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:25:15.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.058 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:25:15.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.115 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:15.115 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:15.115 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:15.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.117 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.117 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.118 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:15.238 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:15.239 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:15.239 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:15.239 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:15.239 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:15.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:15.240 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:15.240 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:15.240 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:15.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:15.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:15.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:15.240 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:15.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.403 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:15.403 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:15.403 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:15.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.405 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:15.424 [DEBUG - pool-196-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.15.52.60:41453, [25ms] received response from server master-127.15.52.60:41453: OK, deferred=null) with no deferred attached!
14:25:15.455 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:15.455 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:15.455 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:15.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.456 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.456 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.456 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:15.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.474772 18862 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.481s	user 0.493s	sys 0.928s
14:25:15.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.398412 18870 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 18862
14:25:15.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.475556 18862 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.482s	user 0.494s	sys 0.928s
14:25:15.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:13.993242 18872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:15.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.476861 18874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:15.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.481674 18873 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1483 milliseconds
14:25:15.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.482110 18862 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:15.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.483508 18862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:15.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.486102 18862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:15.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.487455 18862 hybrid_clock.cc:648] HybridClock initialized: now 1779114315487416 us; error 32 us; skew 500 ppm
14:25:15.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.488287 18862 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:15.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.494619 18862 webserver.cc:533] Webserver started at http://127.18.72.253:43789/ using document root <none> and password file <none>
14:25:15.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.495527 18862 fs_manager.cc:362] Metadata directory not provided
14:25:15.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.495770 18862 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.496244 18862 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.500597 18862 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data/instance:
14:25:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0922646445410b80042082ea094a5c"
14:25:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:15 on dist-test-slave-1n46"
14:25:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.501699 18862 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal/instance:
14:25:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0922646445410b80042082ea094a5c"
14:25:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:15 on dist-test-slave-1n46"
14:25:15.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.508646 18862 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
14:25:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.514227 18887 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.515197 18862 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:25:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.515514 18862 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal
14:25:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0922646445410b80042082ea094a5c"
14:25:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:15 on dist-test-slave-1n46"
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.515863 18862 fs_report.cc:389] FS layout report
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data/data
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:15.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114315541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:15.549 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:15.549 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:25:15.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.575645 18862 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:15.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.577116 18862 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:15.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.577519 18862 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:15.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.655 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:15.655 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:15.655 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:15.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:15.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:15.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:15.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.658092 18862 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.253:45261
14:25:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.658176 18939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.253:45261 every 8 connection(s)
14:25:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.660950 18862 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/data/info.pb
14:25:15.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.663326 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18862
14:25:15.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.663763 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-1/wal/instance
14:25:15.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.666642 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/logs
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data/info.pb
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.252:44649
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.252
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json with env {}
14:25:15.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.668964 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:15.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.681025 18940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
14:25:15.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.705124 18940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } has no permanent_uuid. Determining permanent_uuid...
14:25:15.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.720600 18940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } has no permanent_uuid. Determining permanent_uuid...
14:25:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.723098 18890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.727281 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.776790 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 1
14:25:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.781279 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.849658 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 2
14:25:15.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.853717 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:15.923 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:15.924 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:15.924 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:15.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:15.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:15.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:15.925 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:15.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.943919 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } attempt: 7
14:25:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.946164 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 3
14:25:15.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.957708 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:15.964300 18860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } has no permanent_uuid. Determining permanent_uuid...
14:25:15.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:15.981910 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:15.987 [DEBUG - pool-198-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [8ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:15.987 [DEBUG - pool-198-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [17ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:15.987 [DEBUG - pool-198-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [14ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.016471 18942 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:16.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.017014 18942 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:16.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.017549 18942 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:16.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.040378 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 1
14:25:16.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114316042 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:16.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.046245 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.049 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
14:25:16.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:25:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.053088 18942 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.053311 18942 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.053507 18942 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.053771 18942 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.054001 18942 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.054147 18942 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39783/jwks.json
14:25:16.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.059 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:16.060 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:16.060 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:16.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.060 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.096246 18942 master_runner.cc:387] Master server non-default flags:
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.252:44649
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39783/jwks.json
14:25:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data/info.pb
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.252
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/logs
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:16.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.098045 18942 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:16.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.100014 18942 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.101330 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 4
14:25:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.106797 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.127650 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 2
14:25:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.131037 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.132529 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.217917 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 3
14:25:16.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.224774 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.247 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:16.247 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:16.248 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:16.248 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.248 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.248 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.248 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.249 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:16.268 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:16.269 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:16.269 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:16.270 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.270 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.270 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.270 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.270 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.270 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.271 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:16.274 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [15ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [15ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [13ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [15ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [16ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [23ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [23ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.275 [DEBUG - pool-204-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.15.248.188:46025, [35ms] received response from server master-127.15.248.188:46025: OK, deferred=null) with no deferred attached!
14:25:16.294 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:16.294 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:16.294 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:16.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.295 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.295 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.296 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:16.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.365216 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 4
14:25:16.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.373502 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.406211 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 5
14:25:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.414685 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.503 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:16.503 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:16.504 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:16.504 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.504 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.504 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.504 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.504 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.504 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.505 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:16.541 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114316541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:16.552 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:25:16.553 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:25:16.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.643 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:16.643 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:16.643 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:16.644 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.644 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.644 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.644 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.644 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.645 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.645 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.645 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.645 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.645 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:16.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.657066 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 5
14:25:16.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.666811 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:16.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:16.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:16.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:16.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.668 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.668 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:16.668 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:16.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:16.669 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:16.815 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:16.815 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:16.815 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:16.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.816 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:16.816 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:16.816 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.816 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.816 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:16.816 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:16.869 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:16.870 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:16.870 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:16.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:16.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.871 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:16.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:16.871 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:16.878 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:16.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:16.962288 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 6
14:25:16.996 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:16.996 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:16.996 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:16.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:16.998 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.998 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.998 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:16.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:16.999 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:16.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.985796 18072 debug-util.cc:398] Leaking SignalData structure 0x7b0800082840 after lost signal to thread 18006
14:25:17.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.000635 18072 debug-util.cc:398] Leaking SignalData structure 0x7b08000b18c0 after lost signal to thread 18075
14:25:17.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.038893 18940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:17.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114317041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:17.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.059 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:25:17.061 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:25:17.111 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.219390 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 6
14:25:17.234 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:17.234 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:17.235 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:17.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:17.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:17.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:17.236 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:17.236 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:17.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:17.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:17.236 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:17.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:17.236 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:17.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.263381 18860 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.72.252:44649: Network error: Client connection negotiation failed: client connection to 127.18.72.252:44649: connect: Connection refused (error 111)
14:25:17.272 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:17.272 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:17.272 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:17.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:17.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:17.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:17.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:17.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:17.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:17.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:17.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:17.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:17.275 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:17.288 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:17.288 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:17.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.289 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:17.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.289 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:17.316 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:17.316 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:17.316 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:17.317 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.317 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.317 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.318 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.318 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:17.363 [DEBUG - pool-196-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.15.52.60:41453, [4ms] received response from server master-127.15.52.60:41453: OK, deferred=null) with no deferred attached!
14:25:17.368 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:17.369 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:17.369 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:17.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.370 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.370 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:17.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.541 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114317541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:17.547 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:17.547 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:17.548 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:17.548 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.548 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:17.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:17.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:17.553 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:17.554 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:25:17.555 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:25:17.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.611 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.518455 18953 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 18942
14:25:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:16.134893 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.683283 18956 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1546 milliseconds
14:25:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.682646 18942 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.548s	user 0.553s	sys 0.935s
14:25:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.685238 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:17.685520 18942 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.551s	user 0.554s	sys 0.935s
14:25:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.685842 18942 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:17.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.693115 18942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.695951 18942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.697342 18942 hybrid_clock.cc:648] HybridClock initialized: now 1779114317697245 us; error 75 us; skew 500 ppm
14:25:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.698365 18942 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:17.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.704994 18942 webserver.cc:533] Webserver started at http://127.18.72.252:32975/ using document root <none> and password file <none>
14:25:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.705911 18942 fs_manager.cc:362] Metadata directory not provided
14:25:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.706161 18942 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.706575 18942 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.711086 18942 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data/instance:
14:25:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c2298ea5126a481ba3111caf1b59e630"
14:25:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:17 on dist-test-slave-1n46"
14:25:17.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.712080 18942 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal/instance:
14:25:17.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c2298ea5126a481ba3111caf1b59e630"
14:25:17.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:17 on dist-test-slave-1n46"
14:25:17.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.719872 18942 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
14:25:17.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.725808 18969 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.727032 18942 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:25:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.727378 18942 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal
14:25:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c2298ea5126a481ba3111caf1b59e630"
14:25:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:17 on dist-test-slave-1n46"
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.727715 18942 fs_report.cc:389] FS layout report
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data/data
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:17.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.780550 18942 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.782366 18942 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.782874 18942 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:17.850 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:17.850 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:17.850 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:17.851 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:17.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:17.851 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:17.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:17.851 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:17.851 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:17.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:17.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:17.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:17.851 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:17.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.872345 18942 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.252:44649
14:25:17.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.872448 19020 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.252:44649 every 8 connection(s)
14:25:17.875 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:17.875 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:17.875 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:17.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:17.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:17.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:17.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:17.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:17.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:17.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:17.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:17.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:17.876 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.875053 18942 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/data/info.pb
14:25:17.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:17.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.883077 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 18942
14:25:17.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.883484 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/master-2/wal/instance
14:25:17.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.904196 19021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:17.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.967947 19021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
14:25:17.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:17.998422 19021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } has no permanent_uuid. Determining permanent_uuid...
14:25:18.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.016281 19021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } has no permanent_uuid. Determining permanent_uuid...
14:25:18.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.035259 19021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: Bootstrap starting.
14:25:18.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114318041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:18.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.041934 19021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: Neither blocks nor log segments found. Creating new log.
14:25:18.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.044956 19021 log.cc:826] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: Log is configured to *not* fsync() on all Append() calls
14:25:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.051510 19021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: No bootstrap required, opened a new log
14:25:18.051 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:25:18.052 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:25:18.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.072337 19021 raft_consensus.cc:359] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.073077 19021 raft_consensus.cc:385] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.073293 19021 raft_consensus.cc:740] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2298ea5126a481ba3111caf1b59e630, State: Initialized, Role: FOLLOWER
14:25:18.073 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:18.074 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:18.074 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:18.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:18.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:18.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:18.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:18.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:18.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:18.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:18.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:18.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:18.075 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:18.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.074015 19021 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.077044 19029 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.077863 19029 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.078923 19021 sys_catalog.cc:565] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: configured and running, proceeding with master startup.
14:25:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.099475 18940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 7
14:25:18.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.159574 18940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: Bootstrap starting.
14:25:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.175658 18940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: Neither blocks nor log segments found. Creating new log.
14:25:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.178427 18940 log.cc:826] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: Log is configured to *not* fsync() on all Append() calls
14:25:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.190514 18940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: No bootstrap required, opened a new log
14:25:18.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.193394 19042 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:25:18.202 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:18.202 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:18.202 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:18.203 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.204 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:18.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.198194 18942 master_runner.cc:187] Error getting master registration for 127.18.72.254:35143: OK, instance_id { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" instance_seqno: 1779114313527532 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:18.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.220441 18942 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.223492 18940 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.224414 18940 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:18.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.224717 18940 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0922646445410b80042082ea094a5c, State: Initialized, Role: FOLLOWER
14:25:18.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.225536 18940 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.228571 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.229406 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.230489 18940 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: configured and running, proceeding with master startup.
14:25:18.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:18.266314 19055 catalog_manager.cc:1594] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:25:18.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:18.267243 19055 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:25:18.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.286980 19029 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:18.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.287529 19029 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.259500 18862 master_runner.cc:187] Error getting master registration for 127.18.72.254:35143: OK, instance_id { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" instance_seqno: 1779114313527532 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:18.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.288594 18862 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:18.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:18.289600 18975 tablet.cc:2404] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:18.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.289875 19029 leader_election.cc:290] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0340fcb1c4a748f09ec9e553d81e5858 (127.18.72.254:35143), dc0922646445410b80042082ea094a5c (127.18.72.253:45261)
14:25:18.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.291929 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2298ea5126a481ba3111caf1b59e630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0922646445410b80042082ea094a5c" is_pre_election: true
14:25:18.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.292697 18915 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2298ea5126a481ba3111caf1b59e630 in term 0.
14:25:18.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.296092 18970 leader_election.cc:304] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2298ea5126a481ba3111caf1b59e630, dc0922646445410b80042082ea094a5c; no voters: 
14:25:18.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.296901 19029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:18.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.296936 18860 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } attempt: 7
14:25:18.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.297240 19029 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:18.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.297578 19029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 0 FOLLOWER]: Advancing to term 1
14:25:18.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.306854 19029 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.309985 19029 leader_election.cc:290] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [CANDIDATE]: Term 1 election: Requested vote from peers 0340fcb1c4a748f09ec9e553d81e5858 (127.18.72.254:35143), dc0922646445410b80042082ea094a5c (127.18.72.253:45261)
14:25:18.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.311185 18915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2298ea5126a481ba3111caf1b59e630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0922646445410b80042082ea094a5c"
14:25:18.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.311774 18915 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 0 FOLLOWER]: Advancing to term 1
14:25:18.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.325364 18915 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2298ea5126a481ba3111caf1b59e630 in term 1.
14:25:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.335865 18970 leader_election.cc:304] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2298ea5126a481ba3111caf1b59e630, dc0922646445410b80042082ea094a5c; no voters: 
14:25:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.336675 19029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 1 FOLLOWER]: Leader election won for term 1
14:25:18.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.344494 19029 raft_consensus.cc:697] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [term 1 LEADER]: Becoming Leader. State: Replica: c2298ea5126a481ba3111caf1b59e630, State: Running, Role: LEADER
14:25:18.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:18.345010 18894 tablet.cc:2404] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:18.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.345507 19029 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.357431 19058 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2298ea5126a481ba3111caf1b59e630. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.358301 19058 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: This master's current role is: LEADER
14:25:18.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.369729 19060 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:25:18.374 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:18.374 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:18.375 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:18.375 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.375 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.375 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.376 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.376 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:18.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:18.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.377372 18860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: Bootstrap starting.
14:25:18.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.387352 18860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: Neither blocks nor log segments found. Creating new log.
14:25:18.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.389889 19060 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:25:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.397897 18860 log.cc:826] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: Log is configured to *not* fsync() on all Append() calls
14:25:18.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.404680 18860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: No bootstrap required, opened a new log
14:25:18.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.446949 18860 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.448880 18915 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [term 1 FOLLOWER]: Refusing update from remote peer c2298ea5126a481ba3111caf1b59e630: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.450960 19058 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:18.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.463694 18860 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:18.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.464327 18860 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0340fcb1c4a748f09ec9e553d81e5858, State: Initialized, Role: FOLLOWER
14:25:18.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.465435 18860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } }
14:25:18.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.477315 18860 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: configured and running, proceeding with master startup.
14:25:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.478015 18833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [term 0 FOLLOWER]: Advancing to term 1
14:25:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.478341 18834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2298ea5126a481ba3111caf1b59e630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0340fcb1c4a748f09ec9e553d81e5858"
14:25:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.477576 18835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2298ea5126a481ba3111caf1b59e630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0340fcb1c4a748f09ec9e553d81e5858" is_pre_election: true
14:25:18.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:18.485150 18814 tablet.cc:2404] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:18.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.475421 19065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.490350 19065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.492013 18833 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [term 1 FOLLOWER]: Refusing update from remote peer c2298ea5126a481ba3111caf1b59e630: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:18.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.493629 19058 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:18.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.500089 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2298ea5126a481ba3111caf1b59e630. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.500782 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.507150 19063 mvcc.cc:204] Tried to move back new op lower bound from 7287252248302379008 to 7287252247953072128. Current Snapshot: MvccSnapshot[applied={T|T < 7287252248302379008}]
14:25:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.523798 19058 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.524376 19058 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: This master's current role is: LEADER
14:25:18.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.526239 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.526876 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.531566 19060 catalog_manager.cc:1383] Generated new cluster ID: 842446b421484dbfa96af5c0af76f99d
14:25:18.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.531810 19060 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:25:18.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114318541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:18.553 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:18.554 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:25:18.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.557446 19065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2298ea5126a481ba3111caf1b59e630. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.558197 19065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.563834 19029 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.564388 19029 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630 [sys.catalog]: This master's current role is: LEADER
14:25:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.568053 19068 mvcc.cc:204] Tried to move back new op lower bound from 7287252248302379008 to 7287252247953072128. Current Snapshot: MvccSnapshot[applied={T|T < 7287252248302379008}]
14:25:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.579275 19065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2298ea5126a481ba3111caf1b59e630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0340fcb1c4a748f09ec9e553d81e5858" member_type: VOTER last_known_addr { host: "127.18.72.254" port: 35143 } } peers { permanent_uuid: "dc0922646445410b80042082ea094a5c" member_type: VOTER last_known_addr { host: "127.18.72.253" port: 45261 } } peers { permanent_uuid: "c2298ea5126a481ba3111caf1b59e630" member_type: VOTER last_known_addr { host: "127.18.72.252" port: 44649 } } }
14:25:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.579842 19065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858 [sys.catalog]: This master's current role is: FOLLOWER
14:25:18.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.594409 19060 catalog_manager.cc:1406] Generated new certificate authority record
14:25:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.596065 19060 catalog_manager.cc:1540] Loading token signing keys...
14:25:18.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.644068 19060 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: Generated new TSK 0
14:25:18.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.645074 19060 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:25:18.683 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:18.684 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:18.684 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:18.684 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.684 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.684 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.685 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.685 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.684448 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal
14:25:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data
14:25:18.685 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.685 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.686 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/logs
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data/info.pb
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.193:0
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.193
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.193
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:18.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.701313 19082 catalog_manager.cc:1295] Loaded cluster ID: 842446b421484dbfa96af5c0af76f99d
14:25:18.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.701658 19082 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: loading cluster ID for follower catalog manager: success
14:25:18.703 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:18.703 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:18.703 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:18.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.704 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.704 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:18.704 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.704 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.704 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:18.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.705 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.705 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:18.705 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:18.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.718444 19082 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: acquiring CA information for follower catalog manager: success
14:25:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:18.729341 19082 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 0340fcb1c4a748f09ec9e553d81e5858: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:18.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114319041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:19.051 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:25:19.052 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
14:25:19.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:19.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:19.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:19.169 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.169 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.169 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.169 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.169 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.169 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.169 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.169 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.272888 19055 catalog_manager.cc:1295] Loaded cluster ID: 842446b421484dbfa96af5c0af76f99d
14:25:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.273399 19055 catalog_manager.cc:1588] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: loading cluster ID for follower catalog manager: success
14:25:19.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.280522 19055 catalog_manager.cc:1610] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: acquiring CA information for follower catalog manager: success
14:25:19.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.302175 19055 catalog_manager.cc:1638] T 00000000000000000000000000000000 P dc0922646445410b80042082ea094a5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:19.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.330273 19084 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:19.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.330936 19084 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:19.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.331708 19084 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:19.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:19.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:19.339 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:19.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:19.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:19.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:19.343 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:19.343 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:19.343 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:19.344 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:19.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:19.344 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:19.344 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:19.363 [DEBUG - pool-196-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.15.52.60:41453, [3ms] received response from server master-127.15.52.60:41453: OK, deferred=null) with no deferred attached!
14:25:19.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.390209 19084 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:19.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.391520 19084 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.72.193
14:25:19.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:19.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:19.415 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:19.417 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.417 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.417 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.418 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.418 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.418 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.418 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.418 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.418 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.456235 19084 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.193:0
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data/info.pb
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.193
14:25:19.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:19.457 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.193
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/logs
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:19.457 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:19.457 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:19.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:19.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:19.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:19.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:19.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.458781 19084 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:19.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.460706 19084 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:19.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:19.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:19.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:19.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.484 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.484 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.484 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.484 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.484 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.484 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.484 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:19.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.488278 19091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:19.542 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114319541 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:19.549 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:19.550 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
14:25:19.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.694 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:19.694 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:19.694 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:19.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.696 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:19.699 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:19.699 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:19.699 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:19.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:19.700 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.700 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.700 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:19.701 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.701 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.701 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:19.701 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:19.848 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:19.849 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:19.849 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:19.849 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.849 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.849 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:19.850 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.850 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.850 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:19.850 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.850 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.850 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:19.850 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:19.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:19.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:19.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:19.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:19.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.968 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.968 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.968 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:19.974 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:19.974 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:19.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:19.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:19.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:19.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:19.975 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:19.987 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:19.987 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:19.987 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:19.987 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.987 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.987 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:19.988 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:19.988 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:19.988 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:20.042 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114320041 for job 2c28d6d49adcc0d598680955c9f9304b.
14:25:20.052 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 2c28d6d49adcc0d598680955c9f9304b (1629 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:20.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
14:25:20.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.110 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.193 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:20.194 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:20.194 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:20.194 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.194 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.194 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.195 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:20.222 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:20.222 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:20.223 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:20.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:20.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:20.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:20.224 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:20.350 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.61:40475(127.15.52.61:40475)] connecting to peer
14:25:20.350 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.60:41453(127.15.52.60:41453)] connecting to peer
14:25:20.350 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.15.52.62:42455(127.15.52.62:42455)] connecting to peer
14:25:20.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:20.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.52.61:40475(127.15.52.61:40475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:20.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.61:40475: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475
14:25:20.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:20.351 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.52.60:41453(127.15.52.60:41453)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:20.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.60:41453: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453
14:25:20.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:20.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.52.62:42455(127.15.52.62:42455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:20.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.52.62:42455: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
14:25:20.352 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455; will retry
14:25:20.383 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.384 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
14:25:20.385 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=700268f26d6f48639ecc59e8eadbfc1a, attempt=4, KuduRpc(method=Scan, tablet=700268f26d6f48639ecc59e8eadbfc1a, attempt=4, TimeoutTracker(timeout=30000, elapsed=29006), Traces: [0ms] sending RPC to server e4dbc1022b094e258f077442852021f9, [540ms] received response from server e4dbc1022b094e258f077442852021f9: Network error: connection closed, [541ms] delaying RPC due to: Network error: connection closed, [561ms] sending RPC to server 867085016e264a24b5eae3438bda3c54, [562ms] received response from server 867085016e264a24b5eae3438bda3c54: Network error: Failed to connect to peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157): Connection refused: /127.15.52.2:43157, [562ms] delaying RPC due to: Network error: Failed to connect to peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157): Connection refused: /127.15.52.2:43157, [581ms] sending RPC to server 03dc834ad6514e3387738f0060b29612, [582ms] received response from server 03dc834ad6514e3387738f0060b29612: Network error: Failed to connect to peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821): Connection refused: /127.15.52.1:34821, [582ms] delaying RPC due to: Network error: Failed to connect to peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821): Connection refused: /127.15.52.1:34821, [601ms] refreshing cache from master, [601ms] Sub RPC GetTableLocations: refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [603ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [611ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [646ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [646ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [660ms] Sub RPC GetTableLocations: refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [663ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [663ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [663ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [663ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [663ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [680ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [681ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [701ms] Sub RPC GetTableLocations: refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [702ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [716ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [716ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [717ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [741ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [742ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [742ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [760ms] Sub RPC GetTableLocations: refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [762ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [780ms] Sub RPC GetTableLocations: refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [781ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [920ms] Sub RPC GetTableLocations: refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [921ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [921ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [922ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [922ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1061ms] Sub RPC GetTableLocations: refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1062ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1480ms] Sub RPC GetTableLocations: refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1482ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1760ms] Sub RPC GetTableLocations: refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1761ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3281ms] Sub RPC GetTableLocations: refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3281ms] too many traces: truncated at 100 traces, deferred=Deferred@451809473(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.52.62:42455
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:20.385 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.52.62:42455
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:20.387 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
14:25:20.387 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.52.62:42455
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:20.387 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.52.60:41453(127.15.52.60:41453)] disconnecting while in state TERMINATED
14:25:20.387 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e4dbc1022b094e258f077442852021f9(127.15.52.3:41829)] disconnecting while in state TERMINATED
14:25:20.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.52.61:40475(127.15.52.61:40475)] disconnecting while in state TERMINATED
14:25:20.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 867085016e264a24b5eae3438bda3c54(127.15.52.2:43157)] disconnecting while in state TERMINATED
14:25:20.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 03dc834ad6514e3387738f0060b29612(127.15.52.1:34821)] disconnecting while in state TERMINATED
14:25:20.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.52.62:42455(127.15.52.62:42455)] disconnecting while in state TERMINATED
14:25:20.388 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:20.388 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:20.388 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:20.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.390 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:20.390 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:20.391 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.248.188:46025(127.15.248.188:46025)] disconnecting while in state TERMINATED
14:25:20.391 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 504d6bc3351843caab10c4c62664c443(127.15.248.129:36421)] disconnecting while in state TERMINATED
14:25:20.391 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.248.190:44713(127.15.248.190:44713)] disconnecting while in state TERMINATED
14:25:20.391 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.248.189:37707(127.15.248.189:37707)] disconnecting while in state TERMINATED
14:25:20.391 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:20.392 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:25:20.392 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
14:25:20.392 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-3
14:25:20.392 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-4
14:25:20.393 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
14:25:20.392 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:25:20.392 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
14:25:20.395 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:20.395 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:20.395 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:20.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:20.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:20.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:20.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:20.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:20.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:20.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:20.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:20.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:20.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:20.410 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:25:20.411 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.52.62:42455
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:20.412 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:25:20.410 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:25:20.415 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:25:20.420 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29389, elapsed=28362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475], [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [45ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: [peer master-127.15.52.61:40475(127.15.52.61:40475)] unexpected exception from downstream on [id: 0xcf268985, L:/127.0.0.1:51632 - R:/127.15.52.61:40475],org.apache.kudu.client.RecoverableException: [peer master-127.15.52.60:41453(127.15.52.60:41453)] unexpected exception from downstream on [id: 0x2f91f568, L:/127.0.0.1:37184 - R:/127.15.52.60:41453], [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [80ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [116ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [161ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [179ms] refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [180ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [180ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [319ms] refreshing cache from master, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [320ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [460ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [461ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [461ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [879ms] refreshing cache from master, [879ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [880ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [881ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1159ms] refreshing cache from master, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [1159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [1160ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [1160ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.61:40475: Network error: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.60:41453: Network error: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.15.52.62:42455: Network error: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [2681ms] delaying RPC due to: Service unavailable: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.61:40475, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.60:41453, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.52.62:42455, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@2057092895(state=PENDING, result=null, callback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484), errback=(continuation of Deferred@2052172257 after retry RPC after error@2128039492) -> (continuation of Deferred@1516453270 after retry RPC after error@1159206274) -> (continuation of Deferred@854696545 after retry RPC after error@1980792597) -> (continuation of Deferred@903635916 after retry RPC after error@820888816) -> (continuation of Deferred@254839334 after retry RPC after error@2058204162) -> (continuation of Deferred@741964440 after retry RPC after error@1924002219) -> (continuation of Deferred@2034705506 after retry RPC after error@1851626220) -> (continuation of Deferred@156751877 after retry RPC after error@342511661) -> (continuation of Deferred@1422787318 after retry RPC after error@1443242097) -> (continuation of Deferred@1629904196 after retry RPC after error@663454325) -> (continuation of Deferred@66514368 after retry RPC after error@1679052903) -> (continuation of Deferred@931917276 after retry RPC after error@1281907058) -> (continuation of Deferred@2026120658 after retry RPC after error@1050006981) -> (continuation of Deferred@1444424390 after retry RPC after error@1488280254) -> (continuation of Deferred@17178319 after retry RPC after error@288213207) -> (continuation of Deferred@108301870 after retry RPC after error@1952863476) -> (continuation of Deferred@1160240337 after retry RPC after error@984862674) -> (continuation of Deferred@412361556 after retry RPC after error@1586693446) -> (continuation of Deferred@623483665 after retry RPC after error@29363513) -> (continuation of Deferred@947323094 after retry RPC after error@2114489259) -> (continuation of Deferred@395343464 after retry RPC after error@372770918) -> (continuation of Deferred@382327751 after retry RPC after error@740712294) -> (continuation of Deferred@940662716 after retry RPC after error@1849428960) -> (continuation of Deferred@913564163 after retry RPC after error@674252484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.52.61:40475,127.15.52.60:41453,127.15.52.62:42455) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.61:40475(127.15.52.61:40475): Connection refused: /127.15.52.61:40475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.60:41453(127.15.52.60:41453): Connection refused: /127.15.52.60:41453,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.52.62:42455(127.15.52.62:42455): Connection refused: /127.15.52.62:42455
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.52.62:42455
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:20.422 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:25:20.422 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RUNNING to RESTARTING.
14:25:20.423 [WARN - flink-pekko.actor.default-dispatcher-9] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
14:25:20.423 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:20.424 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:25:20.529 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:20.530 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:20.530 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:20.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.531 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.531 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:20.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.694 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:20.694 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:20.694 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:20.694 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:20.694 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:20.694 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:20.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:20.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:20.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:20.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:20.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:20.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:20.695 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:20.699 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.856 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:20.857 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:20.857 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:20.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.858 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:20.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:20.987 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:20.987 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:20.987 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:20.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:20.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:20.989 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.989 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.989 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:20.989 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:21.032 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:21.032 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:21.032 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:21.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:21.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:21.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:21.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:21.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:21.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:21.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:21.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:21.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:21.034 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:21.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.115 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:21.173704 18367 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac1c0 after lost signal to thread 18221
14:25:21.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:21.174763 18367 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac0c0 after lost signal to thread 18370
14:25:21.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:21.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:21.189 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:21.190 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:21.190 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:21.190 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:21.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:21.190 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:21.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:21.190 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:21.190 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:21.190 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:21.190 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:21.198 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:21.198 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:21.199 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:21.199 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.199 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.199 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.199 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.199 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.199 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.200 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:21.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.506716 19095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:21.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:19.506453 19084 server_base.cc:1061] running on GCE node
14:25:21.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:19.502147 19092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:21.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.333268 19084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:21.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.354620 19084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:21.363 [DEBUG - pool-196-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.15.52.60:41453, [9ms] received response from server master-127.15.52.60:41453: OK, deferred=null) with no deferred attached!
14:25:21.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.370795 19084 hybrid_clock.cc:648] HybridClock initialized: now 1779114321370729 us; error 69 us; skew 500 ppm
14:25:21.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.371922 19084 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:21.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.414515 19084 webserver.cc:533] Webserver started at http://127.18.72.193:44433/ using document root <none> and password file <none>
14:25:21.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.416144 19084 fs_manager.cc:362] Metadata directory not provided
14:25:21.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.416654 19084 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:21.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.417347 19084 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:21.423 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RESTARTING to RUNNING.
14:25:21.424 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 2c28d6d49adcc0d598680955c9f9304b from Checkpoint 69 @ 1779114320041 for 2c28d6d49adcc0d598680955c9f9304b located at file:/tmp/junit9781152734840635638/checkpoints/2c28d6d49adcc0d598680955c9f9304b/chk-69.
14:25:21.425 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
14:25:21.425 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:25:21.426 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:25:21.426 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 8e9538df5a0dfbedb16829666ce7ddc2
14:25:21.426 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:21.426 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:25:21.428 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 8e9538df5a0dfbedb16829666ce7ddc2.
14:25:21.430 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 69 for source Source: KuduSource to checkpoint.
14:25:21.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.436293 19084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data/instance:
14:25:21.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d46e3ac247443b18c01517e6b29eeab"
14:25:21.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:21 on dist-test-slave-1n46"
14:25:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.439911 19084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal/instance:
14:25:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d46e3ac247443b18c01517e6b29eeab"
14:25:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:21 on dist-test-slave-1n46"
14:25:21.441 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:25:21.441 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:25:21.442 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3724e8eb
14:25:21.442 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:21.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:25:21.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:25:21.446 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@121c8c77
14:25:21.448 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:21.449 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:25:21.462 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.462 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.469466 19084 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.004s	sys 0.006s
14:25:21.469 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.470 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.471 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.482 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.489717 19111 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:21.490 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.493028 19084 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.003s	sys 0.001s
14:25:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.493490 19084 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal
14:25:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d46e3ac247443b18c01517e6b29eeab"
14:25:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:21 on dist-test-slave-1n46"
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.494078 19084 fs_report.cc:389] FS layout report
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data/data
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:21.501 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.501 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.501 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.501 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.502 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.502 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.502 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.502 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.522 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.529 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.530 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.530 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.530 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.541 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.541 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.541 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.542 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.562 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.563 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.563 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.563 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.563 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.564 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.582 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.582 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.582 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.584 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.602 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.602 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.602 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.603 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.603 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.603 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.603 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.610 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.662 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.662 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.662 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.663 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.663 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.663 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.663 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.663 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.663 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.664 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.664 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.664 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.702334 19084 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:21.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.708678 19084 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:21.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.710592 19084 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:21.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.726416 19084 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:21.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.742635 19084 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:21.743 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.743075 19084 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:21.743 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:21.743 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.743505 19084 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:21.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:21.743852 19084 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:21.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:21.744 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:21.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:21.744 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:21.744 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:21.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:21.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:21.744 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:21.744 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:21.744 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:21.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.763 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.763 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.763 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.763 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.763 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.763 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.763 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.764 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.779 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:21.779 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:21.780 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:21.780 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:21.780 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:21.780 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:21.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:21.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:21.780 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:21.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:21.781 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:21.781 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:21.781 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:21.782 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1300ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1302ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2240ms] refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@1322400739(state=PENDING, result=null, callback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932), errback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932)))
14:25:21.783 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:25:21.783 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1300ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1302ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2240ms] refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@1322400739(state=PENDING, result=null, callback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932), errback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:21.783 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:25:21.786 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
14:25:21.788 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28544), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [80ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1300ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1302ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2240ms] refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@1322400739(state=PENDING, result=null, callback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932), errback=(continuation of Deferred@1982305921 after retry RPC after error@832838018) -> (continuation of Deferred@1472646549 after retry RPC after error@143980973) -> (continuation of Deferred@1112401312 after retry RPC after error@1395956834) -> (continuation of Deferred@847202804 after retry RPC after error@487163783) -> (continuation of Deferred@818151779 after retry RPC after error@1197755541) -> (continuation of Deferred@261918052 after retry RPC after error@1593312943) -> (continuation of Deferred@1319623434 after retry RPC after error@725755567) -> (continuation of Deferred@1079933198 after retry RPC after error@1577964244) -> (continuation of Deferred@780283284 after retry RPC after error@349114805) -> (continuation of Deferred@661298219 after retry RPC after error@398549344) -> (continuation of Deferred@680530049 after retry RPC after error@1144975007) -> (continuation of Deferred@927382007 after retry RPC after error@722474014) -> (continuation of Deferred@61607397 after retry RPC after error@819286297) -> (continuation of Deferred@845078517 after retry RPC after error@432377156) -> (continuation of Deferred@2053466300 after retry RPC after error@1621271408) -> (continuation of Deferred@617048550 after retry RPC after error@291336087) -> (continuation of Deferred@1076675976 after retry RPC after error@895506398) -> (continuation of Deferred@720867533 after retry RPC after error@1345090515) -> (continuation of Deferred@1980431579 after retry RPC after error@1097042787) -> (continuation of Deferred@1459886714 after retry RPC after error@1686460834) -> (continuation of Deferred@1162382797 after retry RPC after error@414006932)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:21.789 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:21.790 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
14:25:21.790 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
14:25:21.790 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:25:21.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:21.902 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:21.902 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:21.903 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:21.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:21.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:21.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:21.905 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:21.979 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:21.979 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:21.979 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:21.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.980 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.980 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.980 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:21.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:21.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.980 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:21.998 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:21.999 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:21.999 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:21.999 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.999 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:21.999 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:22.000 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:22.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:22.000 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:22.000 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:22.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:22.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:22.000 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:22.013 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:22.013 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:22.014 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:22.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.015 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:22.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.174 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:22.174 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:22.175 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:22.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.176 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.176 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:22.202 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:22.203 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:22.203 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:22.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.204 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.204 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.204 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.204 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:22.243 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:22.243 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:22.243 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:22.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.244 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:22.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.292 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.294 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.294 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.294 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.294 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.295 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29070), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [522ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2024ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4902ms] too many traces: truncated at 100 traces, deferred=Deferred@2028250260(state=PENDING, result=null, callback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237), errback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237)))
14:25:22.296 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.296 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.296 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.297 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.297 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.297 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.297 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.297 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.296 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29070), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [522ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2024ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4902ms] too many traces: truncated at 100 traces, deferred=Deferred@2028250260(state=PENDING, result=null, callback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237), errback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29070), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [522ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2024ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4902ms] too many traces: truncated at 100 traces, deferred=Deferred@2028250260(state=PENDING, result=null, callback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237), errback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:22.310 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29070), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [522ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2024ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4902ms] too many traces: truncated at 100 traces, deferred=Deferred@2028250260(state=PENDING, result=null, callback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237), errback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29070), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [261ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [522ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [522ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1582ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2024ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4902ms] too many traces: truncated at 100 traces, deferred=Deferred@2028250260(state=PENDING, result=null, callback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237), errback=(continuation of Deferred@671929802 after retry RPC after error@986721013) -> (continuation of Deferred@1315836868 after retry RPC after error@334749337) -> (continuation of Deferred@1562377128 after retry RPC after error@1722021244) -> (continuation of Deferred@1483553375 after retry RPC after error@1441210589) -> (continuation of Deferred@2005353330 after retry RPC after error@251023595) -> (continuation of Deferred@1064840360 after retry RPC after error@1400177234) -> (continuation of Deferred@514086813 after retry RPC after error@577322410) -> (continuation of Deferred@1552566307 after retry RPC after error@664184434) -> (continuation of Deferred@456267170 after retry RPC after error@1893596931) -> (continuation of Deferred@2123917931 after retry RPC after error@1815078652) -> (continuation of Deferred@1731944926 after retry RPC after error@2021765085) -> (continuation of Deferred@1165445524 after retry RPC after error@1459376064) -> (continuation of Deferred@1786110288 after retry RPC after error@528434308) -> (continuation of Deferred@1614517526 after retry RPC after error@1410159774) -> (continuation of Deferred@288837678 after retry RPC after error@1955167720) -> (continuation of Deferred@1218889034 after retry RPC after error@1991364964) -> (continuation of Deferred@1563183548 after retry RPC after error@1651841484) -> (continuation of Deferred@470223965 after retry RPC after error@1690686536) -> (continuation of Deferred@1536889029 after retry RPC after error@300603651) -> (continuation of Deferred@892029575 after retry RPC after error@2131148798) -> (continuation of Deferred@2090374627 after retry RPC after error@998074802) -> (continuation of Deferred@1416454952 after retry RPC after error@517922580) -> (continuation of Deferred@651257505 after retry RPC after error@1982966576) -> (continuation of Deferred@1232790269 after retry RPC after error@565486265) -> (continuation of Deferred@217918528 after retry RPC after error@2012118724) -> (continuation of Deferred@1771898830 after retry RPC after error@1840828718) -> (continuation of Deferred@138571765 after retry RPC after error@215885927) -> (continuation of Deferred@226291013 after retry RPC after error@652635237)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.188:44337
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:22.311 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:22.312 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
14:25:22.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.312 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.313 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:22.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.313 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.313 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:22.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.314 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.315 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:22.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:22.316 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
14:25:22.316 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
14:25:22.316 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
14:25:22.317 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
14:25:22.317 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
14:25:22.317 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:25:22.317 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
14:25:22.317 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
14:25:22.319 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:25:22.320 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
14:25:22.320 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
14:25:22.321 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:22.321 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:25:22.321 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:22.323 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:25:22.323 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:25:22.323 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:22.325 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
14:25:22.325 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
14:25:22.325 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
14:25:22.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:25:22.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
14:25:22.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
14:25:22.327 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
14:25:22.328 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
14:25:22.328 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
14:25:22.328 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
14:25:22.329 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:25:22.330 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
14:25:22.330 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:22.332 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:22.333 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.333 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.333 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.333 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.334 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.334 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:25:22.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.353 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.353 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.353 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.355 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.355 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.355 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.355 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.356 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.372 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.373 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.373 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.373 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.373 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.373 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.374 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.374 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.392 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.393 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.393 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.393 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.395 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:22.429324 18072 debug-util.cc:398] Leaking SignalData structure 0x7b08000affe0 after lost signal to thread 18006
14:25:22.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:22.430106 18072 debug-util.cc:398] Leaking SignalData structure 0x7b0800070080 after lost signal to thread 18075
14:25:22.452 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.452 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.452 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.454 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.512 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.512 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.512 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.513 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.513 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.513 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.513 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.514 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.514 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.552 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.552 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.552 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.553 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.553 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.553 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.553 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.553 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.553 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.553 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.553 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.553 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.553 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.563 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:22.564 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:22.564 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:22.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.565 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.565 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:22.572 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:22.572 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:22.572 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:22.572 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.572 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.572 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:22.573 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.573 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.573 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:22.573 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.573 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.573 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:22.573 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:22.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.712883 19084 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.193:35669
14:25:22.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.716701 19084 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/data/info.pb
14:25:22.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.718075 19238 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.193:35669 every 8 connection(s)
14:25:22.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.723469 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 19084
14:25:22.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.724056 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-0/wal/instance
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.744169 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/logs
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data/info.pb
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.194:0
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.194
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.194
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:22.763 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:22.763 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:22.763 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:22.764 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.764 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.764 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:22.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.765 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:22.765 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:22.765 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:22.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.812461 19239 heartbeater.cc:344] Connected to a master server at 127.18.72.253:45261
14:25:22.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.812891 19239 heartbeater.cc:461] Registering TS with master...
14:25:22.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.814085 19239 heartbeater.cc:507] Master 127.18.72.253:45261 requested a full tablet report, sending...
14:25:22.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.817412 18905 ts_manager.cc:194] Registered new tserver with Master: 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669)
14:25:22.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.825798 19240 heartbeater.cc:344] Connected to a master server at 127.18.72.252:44649
14:25:22.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.826133 19240 heartbeater.cc:461] Registering TS with master...
14:25:22.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.826974 19240 heartbeater.cc:507] Master 127.18.72.252:44649 requested a full tablet report, sending...
14:25:22.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.829720 18986 ts_manager.cc:194] Registered new tserver with Master: 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669)
14:25:22.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.832330 18986 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.72.193:33635
14:25:22.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.840122 19244 heartbeater.cc:344] Connected to a master server at 127.18.72.254:35143
14:25:22.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.840466 19244 heartbeater.cc:461] Registering TS with master...
14:25:22.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.841152 19244 heartbeater.cc:507] Master 127.18.72.254:35143 requested a full tablet report, sending...
14:25:22.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:22.844242 18825 ts_manager.cc:194] Registered new tserver with Master: 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669)
14:25:22.848 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:22.848 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:22.848 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:22.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:22.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:22.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:22.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:22.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:22.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:22.849 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:22.849 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:22.849 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:22.849 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:22.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:22.883 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:22.883 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:22.883 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:22.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:22.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.884 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.884 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:22.885 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.885 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.885 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:22.885 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:22.974 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:22.975 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:22.975 [DEBUG - pool-257-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:22.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.976 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:22.977 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29744), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [14ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [15ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [28ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [29ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [46ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [46ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [120ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [621ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [621ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [621ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [621ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1622ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4221ms] refreshing cache from master, [4221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4223ms] too many traces: truncated at 100 traces, deferred=Deferred@48284376(state=PENDING, result=null, callback=(continuation of Deferred@871707828 after retry RPC after error@1478168317) -> (continuation of Deferred@1429194798 after retry RPC after error@1365063249) -> (continuation of Deferred@1268246618 after retry RPC after error@1274768179) -> (continuation of Deferred@1623110874 after retry RPC after error@1483335970) -> (continuation of Deferred@742920013 after retry RPC after error@1014647556) -> (continuation of Deferred@704065589 after retry RPC after error@1052835024) -> (continuation of Deferred@1377746466 after retry RPC after error@1020460302) -> (continuation of Deferred@749995065 after retry RPC after error@355158787) -> (continuation of Deferred@845350954 after retry RPC after error@426944997) -> (continuation of Deferred@367780670 after retry RPC after error@1524093395) -> (continuation of Deferred@1885319419 after retry RPC after error@2087584404) -> (continuation of Deferred@911666228 after retry RPC after error@1382804068) -> (continuation of Deferred@1597915322 after retry RPC after error@1397265259) -> (continuation of Deferred@1384047226 after retry RPC after error@1607146139) -> (continuation of Deferred@1918741064 after retry RPC after error@1704574115) -> (continuation of Deferred@1079111512 after retry RPC after error@1204365835) -> (continuation of Deferred@1482278736 after retry RPC after error@1888289884) -> (continuation of Deferred@1072238138 after retry RPC after error@830399166) -> (continuation of Deferred@655081606 after retry RPC after error@1069322207) -> (continuation of Deferred@1213451980 after retry RPC after error@251575914) -> (continuation of Deferred@2005422275 after retry RPC after error@747764634) -> (continuation of Deferred@2053272938 after retry RPC after error@18123170) -> (continuation of Deferred@883941131 after retry RPC after error@390184751), errback=(continuation of Deferred@871707828 after retry RPC after error@1478168317) -> (continuation of Deferred@1429194798 after retry RPC after error@1365063249) -> (continuation of Deferred@1268246618 after retry RPC after error@1274768179) -> (continuation of Deferred@1623110874 after retry RPC after error@1483335970) -> (continuation of Deferred@742920013 after retry RPC after error@1014647556) -> (continuation of Deferred@704065589 after retry RPC after error@1052835024) -> (continuation of Deferred@1377746466 after retry RPC after error@1020460302) -> (continuation of Deferred@749995065 after retry RPC after error@355158787) -> (continuation of Deferred@845350954 after retry RPC after error@426944997) -> (continuation of Deferred@367780670 after retry RPC after error@1524093395) -> (continuation of Deferred@1885319419 after retry RPC after error@2087584404) -> (continuation of Deferred@911666228 after retry RPC after error@1382804068) -> (continuation of Deferred@1597915322 after retry RPC after error@1397265259) -> (continuation of Deferred@1384047226 after retry RPC after error@1607146139) -> (continuation of Deferred@1918741064 after retry RPC after error@1704574115) -> (continuation of Deferred@1079111512 after retry RPC after error@1204365835) -> (continuation of Deferred@1482278736 after retry RPC after error@1888289884) -> (continuation of Deferred@1072238138 after retry RPC after error@830399166) -> (continuation of Deferred@655081606 after retry RPC after error@1069322207) -> (continuation of Deferred@1213451980 after retry RPC after error@251575914) -> (continuation of Deferred@2005422275 after retry RPC after error@747764634) -> (continuation of Deferred@2053272938 after retry RPC after error@18123170) -> (continuation of Deferred@883941131 after retry RPC after error@390184751)))
14:25:22.982 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:22.982 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:22.983 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:22.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:22.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:22.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:22.984 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:22.985 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29747), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [11ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [11ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [24ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [45ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [160ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [361ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [481ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [660ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [660ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [661ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2520ms] refreshing cache from master, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2523ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [6480ms] refreshing cache from master, [6481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6482ms] too many traces: truncated at 100 traces, deferred=Deferred@840115983(state=PENDING, result=null, callback=(continuation of Deferred@773130462 after retry RPC after error@1418755171) -> (continuation of Deferred@1818069946 after retry RPC after error@1205727841) -> (continuation of Deferred@1091060156 after retry RPC after error@372006554) -> (continuation of Deferred@380372926 after retry RPC after error@1053467120) -> (continuation of Deferred@1036784180 after retry RPC after error@1231049625) -> (continuation of Deferred@1057434876 after retry RPC after error@1412026317) -> (continuation of Deferred@162085582 after retry RPC after error@1117674745) -> (continuation of Deferred@1157163162 after retry RPC after error@1580531823) -> (continuation of Deferred@503987757 after retry RPC after error@776196225) -> (continuation of Deferred@771510763 after retry RPC after error@1530665539) -> (continuation of Deferred@344501343 after retry RPC after error@612344215) -> (continuation of Deferred@1807994874 after retry RPC after error@1343631043) -> (continuation of Deferred@19765962 after retry RPC after error@1476911201) -> (continuation of Deferred@768497796 after retry RPC after error@1280252872) -> (continuation of Deferred@559489857 after retry RPC after error@1186651107) -> (continuation of Deferred@426746312 after retry RPC after error@768243830) -> (continuation of Deferred@1172374949 after retry RPC after error@1427422009) -> (continuation of Deferred@831599026 after retry RPC after error@1332143678) -> (continuation of Deferred@40308314 after retry RPC after error@1918541916) -> (continuation of Deferred@1249776388 after retry RPC after error@844192611) -> (continuation of Deferred@150902445 after retry RPC after error@788635566) -> (continuation of Deferred@358436729 after retry RPC after error@762287346), errback=(continuation of Deferred@773130462 after retry RPC after error@1418755171) -> (continuation of Deferred@1818069946 after retry RPC after error@1205727841) -> (continuation of Deferred@1091060156 after retry RPC after error@372006554) -> (continuation of Deferred@380372926 after retry RPC after error@1053467120) -> (continuation of Deferred@1036784180 after retry RPC after error@1231049625) -> (continuation of Deferred@1057434876 after retry RPC after error@1412026317) -> (continuation of Deferred@162085582 after retry RPC after error@1117674745) -> (continuation of Deferred@1157163162 after retry RPC after error@1580531823) -> (continuation of Deferred@503987757 after retry RPC after error@776196225) -> (continuation of Deferred@771510763 after retry RPC after error@1530665539) -> (continuation of Deferred@344501343 after retry RPC after error@612344215) -> (continuation of Deferred@1807994874 after retry RPC after error@1343631043) -> (continuation of Deferred@19765962 after retry RPC after error@1476911201) -> (continuation of Deferred@768497796 after retry RPC after error@1280252872) -> (continuation of Deferred@559489857 after retry RPC after error@1186651107) -> (continuation of Deferred@426746312 after retry RPC after error@768243830) -> (continuation of Deferred@1172374949 after retry RPC after error@1427422009) -> (continuation of Deferred@831599026 after retry RPC after error@1332143678) -> (continuation of Deferred@40308314 after retry RPC after error@1918541916) -> (continuation of Deferred@1249776388 after retry RPC after error@844192611) -> (continuation of Deferred@150902445 after retry RPC after error@788635566) -> (continuation of Deferred@358436729 after retry RPC after error@762287346)))
14:25:23.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.133 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:23.133 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:23.133 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:23.134 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.134 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.134 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.134 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:23.134 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:23.135 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:23.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.136 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:23.136 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.136 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:23.186 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:23.187 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:23.187 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:23.187 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.187 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.187 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.187 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.187 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.188 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:23.235 [DEBUG - pool-256-thread-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [16ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [16ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [28ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [29ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [31ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [31ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [183ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1622ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2963ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2963ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2964ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4700ms] refreshing cache from master, [4701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4702ms] too many traces: truncated at 100 traces, deferred=Deferred@867559752(state=PENDING, result=null, callback=(continuation of Deferred@905284400 after retry RPC after error@2000479512) -> (continuation of Deferred@434778495 after retry RPC after error@84505763) -> (continuation of Deferred@473744185 after retry RPC after error@213447043) -> (continuation of Deferred@1141983394 after retry RPC after error@175341807) -> (continuation of Deferred@1890369427 after retry RPC after error@1003711724) -> (continuation of Deferred@1967744876 after retry RPC after error@1663825362) -> (continuation of Deferred@1986960899 after retry RPC after error@1450850350) -> (continuation of Deferred@1756776330 after retry RPC after error@1418705451) -> (continuation of Deferred@1452517439 after retry RPC after error@1370440075) -> (continuation of Deferred@192927267 after retry RPC after error@570977157) -> (continuation of Deferred@1771171243 after retry RPC after error@1108957707) -> (continuation of Deferred@924996261 after retry RPC after error@1444369287) -> (continuation of Deferred@806158427 after retry RPC after error@944557395) -> (continuation of Deferred@492705669 after retry RPC after error@1908012226) -> (continuation of Deferred@703475062 after retry RPC after error@1997953869) -> (continuation of Deferred@437884949 after retry RPC after error@616063088) -> (continuation of Deferred@2087021580 after retry RPC after error@971803902) -> (continuation of Deferred@1877177062 after retry RPC after error@138355850) -> (continuation of Deferred@1609378957 after retry RPC after error@45859058) -> (continuation of Deferred@1992029697 after retry RPC after error@122787624) -> (continuation of Deferred@829311499 after retry RPC after error@1829675140) -> (continuation of Deferred@1152141530 after retry RPC after error@1330610096) -> (continuation of Deferred@204626496 after retry RPC after error@346083778) -> (continuation of Deferred@845984020 after retry RPC after error@116058646) -> (continuation of Deferred@412369105 after retry RPC after error@170437824) -> (continuation of Deferred@1562069120 after retry RPC after error@208708463) -> (continuation of Deferred@911796472 after retry RPC after error@2044267615), errback=(continuation of Deferred@905284400 after retry RPC after error@2000479512) -> (continuation of Deferred@434778495 after retry RPC after error@84505763) -> (continuation of Deferred@473744185 after retry RPC after error@213447043) -> (continuation of Deferred@1141983394 after retry RPC after error@175341807) -> (continuation of Deferred@1890369427 after retry RPC after error@1003711724) -> (continuation of Deferred@1967744876 after retry RPC after error@1663825362) -> (continuation of Deferred@1986960899 after retry RPC after error@1450850350) -> (continuation of Deferred@1756776330 after retry RPC after error@1418705451) -> (continuation of Deferred@1452517439 after retry RPC after error@1370440075) -> (continuation of Deferred@192927267 after retry RPC after error@570977157) -> (continuation of Deferred@1771171243 after retry RPC after error@1108957707) -> (continuation of Deferred@924996261 after retry RPC after error@1444369287) -> (continuation of Deferred@806158427 after retry RPC after error@944557395) -> (continuation of Deferred@492705669 after retry RPC after error@1908012226) -> (continuation of Deferred@703475062 after retry RPC after error@1997953869) -> (continuation of Deferred@437884949 after retry RPC after error@616063088) -> (continuation of Deferred@2087021580 after retry RPC after error@971803902) -> (continuation of Deferred@1877177062 after retry RPC after error@138355850) -> (continuation of Deferred@1609378957 after retry RPC after error@45859058) -> (continuation of Deferred@1992029697 after retry RPC after error@122787624) -> (continuation of Deferred@829311499 after retry RPC after error@1829675140) -> (continuation of Deferred@1152141530 after retry RPC after error@1330610096) -> (continuation of Deferred@204626496 after retry RPC after error@346083778) -> (continuation of Deferred@845984020 after retry RPC after error@116058646) -> (continuation of Deferred@412369105 after retry RPC after error@170437824) -> (continuation of Deferred@1562069120 after retry RPC after error@208708463) -> (continuation of Deferred@911796472 after retry RPC after error@2044267615)))
14:25:23.243 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:23.244 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:23.244 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:23.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.245 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.245 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.245 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.245 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:23.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.272511 19243 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:23.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.273234 19243 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:23.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.273943 19243 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:23.308 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:23.309 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:23.309 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:23.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.309 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.309 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.309 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.310 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:23.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.333743 19243 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:23.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.335124 19243 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.72.194
14:25:23.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:23.397693 19243 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.194:0
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data/info.pb
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.194
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.194
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/logs
14:25:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:23.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:23.400625 19243 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:23.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:23.402937 19243 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:23.422 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:23.423 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:23.423 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:23.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:23.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:23.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:23.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:23.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:23.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:23.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:23.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:23.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:23.424 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:23.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.432090 19255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:23.508 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:23.508 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:23.508 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:23.508 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:23.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:23.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:23.509 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:23.509 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:23.509 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:23.509 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:23.510 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:23.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:23.510 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:23.515 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:23.515 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:23.515 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:23.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:23.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.516 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:23.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:23.516 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:23.532 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:23.532 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:23.532 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:23.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.532 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:23.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.533 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:23.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:23.533 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:23.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:23.836869 19240 heartbeater.cc:499] Master 127.18.72.252:44649 was elected leader, sending a full tablet report...
14:25:23.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:23.967 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:23.967 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:23.968 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:23.968 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:23.968 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.968 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.968 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:23.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:23.969 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:24.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.149 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:24.149 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:24.149 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:24.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.150 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:24.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.393 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:24.394 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:24.394 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:24.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.395 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:24.437 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:24.437 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:24.437 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:24.438 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.438 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.438 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:24.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:24.443 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.443 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.443 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:24.443 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:24.455 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:24.455 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:24.455 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:24.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.457 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:24.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.799 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:24.799 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:24.799 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:24.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:24.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:24.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:24.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:24.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:24.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:24.801 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:24.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:24.801 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:24.801 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:24.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:24.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:24.843 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:24.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:24.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.845 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.845 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:24.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:24.845 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:24.856 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:25:24.857 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:25:24.858 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:25:24.858 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:24.859 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
14:25:24.860 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
14:25:24.860 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:25:24.861 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
14:25:24.861 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
14:25:24.861 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:25:24.861 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
14:25:24.862 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
14:25:24.862 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:25:24.862 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
14:25:24.863 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
14:25:24.863 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:25:24.863 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:24.863 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:24.864 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:24.864 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:24.866 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:25:24.867 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:25:24.868 [INFO - Thread-44] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:24.868 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:25:24.868 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:25:24.869 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:25:24.869 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:24.869 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:25:24.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:25:24.871 [INFO - Thread-44] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:24.871 [INFO - Thread-44] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:24.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.874 [DEBUG - Thread-44] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:24.874 [INFO - Thread-44] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:24.875 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
14:25:24.875 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
14:25:24.875 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3123ba73
14:25:24.875 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:24.876 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:24.876 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:25:24.876 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:25:24.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:24.881 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@19b12686
14:25:24.884 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:24.884 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:25:24.885 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:25:24.886 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
14:25:24.886 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
14:25:24.886 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61f767e6
14:25:24.886 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:24.886 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:24.887 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:25:24.887 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:25:24.889 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:25:24.891 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:25:24.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
14:25:24.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
14:25:24.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e8df69a
14:25:24.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:24.893 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:24.893 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:25:24.893 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:25:24.894 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f2b62f4
14:25:24.898 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:24.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:24.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:24.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:24.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:24.902 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bdbce71
14:25:24.904 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:24.905 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
14:25:24.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
14:25:24.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69ac21b7
14:25:24.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:24.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:24.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:25:24.909 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:25:24.912 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@654b183d
14:25:24.914 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.917 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:24.918 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.919 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.920 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.921 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.921 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.922 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.922 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.922 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.922 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.922 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:24.923 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.924 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.924 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.924 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.926 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.926 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.926 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:24.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.927 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:24.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.929 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.929 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:24.929 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.930 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.930 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.930 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.930 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.932 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.932 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.933 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.935 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.936 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.936 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.937 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.938 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.939 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.939 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.939 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.942 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.942 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.943 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:24.944 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.944 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.944 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.944 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.944 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:24.945 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.945 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.945 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:24.945 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:24.945 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.946 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.946 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.946 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:24.947 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.947 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.947 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:24.947 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:24.947 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.948 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.948 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.948 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.948 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.949 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.950 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.954 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.956 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.958 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.962 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.963 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:24.963 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.963 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.963 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.964 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.966 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.966 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.966 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.967 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.970 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.971 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.971 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.972 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.976 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.983 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.985 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.985 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.987 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:24.987 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:24.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:24.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.988 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.989 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.989 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:24.994 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:24.995 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.995 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:24.995 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:24.999 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.004 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.006 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.006 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.006 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.008 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.009 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.009 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.009 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.009 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.017 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.023 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.023 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.023 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.023 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.024 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.024 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.024 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.024 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.024 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.024 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.024 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.025 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.025 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.025 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.025 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.025 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.025 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.025 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.025 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.025 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.026 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.026 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.027 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.028 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.028 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.028 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.029 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.029 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.029 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.029 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.029 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.031 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.032 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.032 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.032 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.032 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.034 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.035 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.035 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.036 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.036 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.037 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.037 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.037 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.037 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.037 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.038 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.038 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.038 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.038 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.038 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.038 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.038 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.039 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.039 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.039 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.040 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.040 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.040 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.040 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.040 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.040 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.041 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.041 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.041 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.043 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.043 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.043 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.044 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.046 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.046 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.046 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.047 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.048 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.054 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.054 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.056 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.057 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.057 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.057 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.057 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.058 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.058 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.058 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.059 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.059 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.059 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.059 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.060 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.060 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.060 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.060 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.060 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.060 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.060 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.060 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.060 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.060 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.060 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.060 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.061 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.063 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.064 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.064 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.064 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.064 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.065 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.065 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.066 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.066 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.074 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.074 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.074 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.076 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.076 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.077 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.077 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.077 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.078 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.078 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.078 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.078 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.078 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.079 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.079 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.096 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.097 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.097 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.101 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.101 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.101 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.102 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.102 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.102 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.102 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.103 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.103 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.103 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.104 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.104 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.104 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.105 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.105 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.123 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:25.123 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:25.123 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:25.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:25.123 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:25.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:25.123 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:25.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:25.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:25.124 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:25.124 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:25.124 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:25.124 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:25.126 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.126 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.126 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.127 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.128 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.139 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.139 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.139 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.142 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.145 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.146 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.146 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.147 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.147 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.147 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.148 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.176 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.177 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.177 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.179 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.179 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.180 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.180 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.180 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.181 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.181 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.181 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.184 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.186 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.186 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.186 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.225 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.225 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.225 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.225 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.225 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.226 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.226 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.227 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.254 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.255 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.255 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.256 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.256 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.256 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.256 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.257 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.258 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.259 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.259 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.274 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.274 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.275 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.276 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.276 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.276 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.276 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.276 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.276 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.276 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.316 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.317 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.317 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.318 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.318 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.318 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.318 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.318 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.318 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.328 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:25.328 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:25.328 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:25.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:25.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:25.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:25.328 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:25.328 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:25.328 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:25.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:25.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:25.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:25.329 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:25.358 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.359 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.359 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.361 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.361 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.361 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.361 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.379 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:24.826983 19254 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 19243
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:25.406153 19254 kernel_stack_watchdog.cc:198] Thread 19243 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 388ms:
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:23.434530 19256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:25.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:25.407840 19257 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1972 milliseconds
14:25:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:25.411937 19243 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.976s	user 0.005s	sys 0.001s
14:25:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:25.412287 19243 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.977s	user 0.005s	sys 0.001s
14:25:25.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:25.413800 19259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:25.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.413772 19243 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:25.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.415258 19243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:25.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.417639 19243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:25.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.419060 19243 hybrid_clock.cc:648] HybridClock initialized: now 1779114325418937 us; error 112 us; skew 500 ppm
14:25:25.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.420101 19243 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.427263 19243 webserver.cc:533] Webserver started at http://127.18.72.194:45999/ using document root <none> and password file <none>
14:25:25.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.428417 19243 fs_manager.cc:362] Metadata directory not provided
14:25:25.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.428664 19243 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:25.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.429261 19243 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.435048 19243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data/instance:
14:25:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:25 on dist-test-slave-1n46"
14:25:25.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.436434 19243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal/instance:
14:25:25.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:25.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:25 on dist-test-slave-1n46"
14:25:25.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.445643 19243 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
14:25:25.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.452553 19322 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:25.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.453591 19243 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
14:25:25.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.454052 19243 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal
14:25:25.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:25.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:25 on dist-test-slave-1n46"
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.455564 19243 fs_report.cc:389] FS layout report
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data/data
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:25.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:25.463 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.463 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.463 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.464 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.496 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.497 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.497 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.497 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.497 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.497 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.497 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.497 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.497 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.497 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.515136 19243 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.516409 19243 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:25.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.516808 19243 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:25.518 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.518 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.519 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.519 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.519 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.519 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.519 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.519 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.519536 19243 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:25.519 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.519 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.523614 19243 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:25.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.523824 19243 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:25.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.524104 19243 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:25.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.524267 19243 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:25.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.626 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.627 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.627 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.628 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.628 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.656 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.656 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.656 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.657 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.657 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.657 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.658 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.658 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.658 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.690042 19243 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.194:41419
14:25:25.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.690115 19435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.194:41419 every 8 connection(s)
14:25:25.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.692955 19243 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/data/info.pb
14:25:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.694413 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 19243
14:25:25.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.694937 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-1/wal/instance
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.721122 18723 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/logs
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data/info.pb
14:25:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.195:0
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.195
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.195
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:25.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.736 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.736 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.736 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.736 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.762077 19436 heartbeater.cc:344] Connected to a master server at 127.18.72.253:45261
14:25:25.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.762547 19436 heartbeater.cc:461] Registering TS with master...
14:25:25.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.764518 19436 heartbeater.cc:507] Master 127.18.72.253:45261 requested a full tablet report, sending...
14:25:25.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.767848 18905 ts_manager.cc:194] Registered new tserver with Master: 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419)
14:25:25.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.770314 19437 heartbeater.cc:344] Connected to a master server at 127.18.72.252:44649
14:25:25.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.770666 19437 heartbeater.cc:461] Registering TS with master...
14:25:25.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.771528 19437 heartbeater.cc:507] Master 127.18.72.252:44649 requested a full tablet report, sending...
14:25:25.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.773204 18986 ts_manager.cc:194] Registered new tserver with Master: 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419)
14:25:25.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.774448 18986 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.72.194:40203
14:25:25.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.775264 19438 heartbeater.cc:344] Connected to a master server at 127.18.72.254:35143
14:25:25.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.775542 19438 heartbeater.cc:461] Registering TS with master...
14:25:25.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.776280 19438 heartbeater.cc:507] Master 127.18.72.254:35143 requested a full tablet report, sending...
14:25:25.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:25.780005 18825 ts_manager.cc:194] Registered new tserver with Master: 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419)
14:25:25.783 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:25.783 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:25.783 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:25.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:25.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:25.784 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.784 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.784 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:25.784 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:25.865 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:25.866 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:25.866 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:25.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.866 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.866 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:25.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:25.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:25.867 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:25.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:25.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.009 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:26.009 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:26.009 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:26.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.009 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.009 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.009 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.010 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.010 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.010 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:26.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.081380 19444 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.082048 19444 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.082855 19444 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:26.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.117698 19444 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:26.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.118512 19444 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.72.195
14:25:26.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:26.166150 19444 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.18.72.212:36929
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.18.72.195:0
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data/info.pb
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.18.72.195
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.18.72.254:35143,127.18.72.253:45261,127.18.72.252:44649
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.18.72.195
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/logs
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:26.168486 19444 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:26.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:26.170666 19444 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:26.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.187813 19453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:26.236 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:26.236 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:26.236 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:26.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.237 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.237 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.237 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.238 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.238 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.238 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.238 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:26.367 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:26.368 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:26.368 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:26.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.368 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.368 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.368 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.369 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:26.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.383 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:26.383 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:26.384 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:26.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:26.384 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:26.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:26.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:26.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:26.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:26.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:26.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:26.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:26.385 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:26.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:26.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:26.403 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:26.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:26.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:26.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:26.403 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:26.403 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:26.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:26.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:26.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:26.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:26.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:26.479 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:26.479 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:26.479 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:26.481 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.481 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.481 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.482 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.482 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.482 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.482 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.483 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:26.537 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:26.537 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:26.537 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:26.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.538 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:26.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.594 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:26.594 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:26.595 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:26.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.596 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.596 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.596 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.596 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.596 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:26.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.627 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:26.627 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:26.627 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:26.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.628 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.628 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.628 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.628 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.628 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.629 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:26.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:26.779670 19437 heartbeater.cc:499] Master 127.18.72.252:44649 was elected leader, sending a full tablet report...
14:25:26.848 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:26.848 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:26.848 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:26.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.849 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:26.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:26.849 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:26.850 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:26.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:26.877 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:26.877 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:26.877 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:26.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:26.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:26.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:26.878 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:26.960 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:26.960 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:26.960 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:26.961 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:26.961 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:26.961 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:26.961 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:26.961 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:26.961 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:26.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:26.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:26.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:26.962 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:27.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.201890 18709 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad180 after lost signal to thread 18584
14:25:27.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.203401 18709 debug-util.cc:398] Leaking SignalData structure 0x7b08000adc20 after lost signal to thread 18712
14:25:27.322 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:27.322 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:27.322 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:27.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:27.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:27.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:27.323 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:27.323 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:27.323 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:27.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:27.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:27.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:27.324 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:27.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.379 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:27.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:27.454 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:27.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:27.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:27.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:27.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:27.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:27.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:27.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:27.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:27.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:27.456 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:27.468 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:27.468 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:27.468 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:27.468 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:27.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:27.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:27.469 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:27.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:27.469 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:27.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:27.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:27.469 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:27.470 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:27.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:27.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:27.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:27.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.600 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.601 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.593797 19452 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 19444
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.602787 19452 kernel_stack_watchdog.cc:198] Thread 19444 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 385ms:
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:27.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:26.194149 19454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:27.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.610711 19444 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.406s	user 0.003s	sys 0.001s
14:25:27.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.611238 19444 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.407s	user 0.004s	sys 0.001s
14:25:27.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:27.613054 19456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:27.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.614805 19444 server_base.cc:1061] running on GCE node
14:25:27.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.616159 19444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:27.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.618711 19444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:27.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.620162 19444 hybrid_clock.cc:648] HybridClock initialized: now 1779114327620069 us; error 105 us; skew 500 ppm
14:25:27.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.621376 19444 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:27.623 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:27.623 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:27.623 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:27.623 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:27.623 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:27.623 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:27.623 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:27.623 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:27.623 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:27.624 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:27.624 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:27.624 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:27.624 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:27.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.629210 19444 webserver.cc:533] Webserver started at http://127.18.72.195:37205/ using document root <none> and password file <none>
14:25:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.630452 19444 fs_manager.cc:362] Metadata directory not provided
14:25:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.630736 19444 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.631297 19444 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:27.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.638556 19444 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data/instance:
14:25:27.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6420fff486b542d4af7311f720e1b3b3"
14:25:27.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:27 on dist-test-slave-1n46"
14:25:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.639777 19444 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal/instance:
14:25:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6420fff486b542d4af7311f720e1b3b3"
14:25:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:27 on dist-test-slave-1n46"
14:25:27.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.647684 19444 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
14:25:27.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.653738 19464 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.655028 19444 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:25:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.655339 19444 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal
14:25:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6420fff486b542d4af7311f720e1b3b3"
14:25:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:27 on dist-test-slave-1n46"
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.655685 19444 fs_report.cc:389] FS layout report
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data/data
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:27.676 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:27.676 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:27.676 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:27.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:27.677 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:27.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:27.678 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.725490 19444 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:27.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.727061 19444 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:27.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.727643 19444 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:27.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.730669 19444 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.735780 19444 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.736001 19444 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.736356 19444 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.736542 19444 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:27.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:27.889 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:27.889 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:27.889 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:27.890 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:27.890 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:27.890 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:27.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:27.891 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:27.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:27.891 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:27.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:27.891 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:27.891 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.984921 19444 rpc_server.cc:307] RPC server started. Bound to: 127.18.72.195:46487
14:25:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.985092 19576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.72.195:46487 every 8 connection(s)
14:25:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.987694 19444 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/data/info.pb
14:25:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.988374 18723 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 19444
14:25:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:27.988868 18723 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster7977915469928031860/ts-2/wal/instance
14:25:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.037949 19577 heartbeater.cc:344] Connected to a master server at 127.18.72.253:45261
14:25:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.038589 19577 heartbeater.cc:461] Registering TS with master...
14:25:28.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.039992 19577 heartbeater.cc:507] Master 127.18.72.253:45261 requested a full tablet report, sending...
14:25:28.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.045812 18904 ts_manager.cc:194] Registered new tserver with Master: 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:28.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.049817 19578 heartbeater.cc:344] Connected to a master server at 127.18.72.252:44649
14:25:28.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.050141 19578 heartbeater.cc:461] Registering TS with master...
14:25:28.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.050937 19578 heartbeater.cc:507] Master 127.18.72.252:44649 requested a full tablet report, sending...
14:25:28.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.053642 18985 ts_manager.cc:194] Registered new tserver with Master: 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:28.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.055545 18985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.72.195:47775
14:25:28.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.059844 19581 heartbeater.cc:344] Connected to a master server at 127.18.72.254:35143
14:25:28.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.060148 19581 heartbeater.cc:461] Registering TS with master...
14:25:28.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.060699 19581 heartbeater.cc:507] Master 127.18.72.254:35143 requested a full tablet report, sending...
14:25:28.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.063256 18824 ts_manager.cc:194] Registered new tserver with Master: 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.077404 18723 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:25:28.093 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:28.093 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:25:28.094 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.18.72.254"
      port: 35143
    }
    bound_http_address {
      host: "127.18.72.254"
      port: 41715
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.18.72.253"
      port: 45261
    }
    bound_http_address {
      host: "127.18.72.253"
      port: 43789
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.18.72.252"
      port: 44649
    }
    bound_http_address {
      host: "127.18.72.252"
      port: 32975
    }
  }
}

14:25:28.094 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:25:28.095 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.18.72.193"
      port: 35669
    }
    bound_http_address {
      host: "127.18.72.193"
      port: 44433
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.18.72.194"
      port: 41419
    }
    bound_http_address {
      host: "127.18.72.194"
      port: 45999
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.18.72.195"
      port: 46487
    }
    bound_http_address {
      host: "127.18.72.195"
      port: 37205
    }
  }
}

14:25:28.095 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:25:28.096 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:28.098 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:28.098 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:28.099 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:28.099 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.128.62:37019(127.17.128.62:37019)] Successfully connected to peer
14:25:28.101 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.128.61:34199(127.17.128.61:34199)] Successfully connected to peer
14:25:28.103 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.61
14:25:28.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.131 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.62
14:25:28.134 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.128.60:42293(127.17.128.60:42293)] Successfully connected to peer
14:25:28.135 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:28.140 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbb4c7265, L:/127.0.0.1:40294 - R:/127.17.128.61:34199] using SASL/PLAIN
14:25:28.144 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.60
14:25:28.152 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:28.155 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfa6e34d8, L:/127.0.0.1:53482 - R:/127.17.128.62:37019] using SASL/PLAIN
14:25:28.157 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:28.161 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xeca3bcf0, L:/127.0.0.1:56364 - R:/127.17.128.60:42293] using SASL/PLAIN
14:25:28.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:28.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=69), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [48ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: OK, deferred=null) after lookup
14:25:28.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.168414 18120 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56364:
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\001d\000\000\000\004\001\310\000\000\000"
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:25:28.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:25:28.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:25:28.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:25:28.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:28.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:28.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:28.173410 18120 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:25:28.188 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:28.189 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:28.189 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:28.189 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.189 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.189 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.189 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.190 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.190 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.190 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.190 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:28.234 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:28.234 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:28.234 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:28.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:28.248 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:28.248 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:28.249 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:28.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.250 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.250 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.250 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.250 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:28.263 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:28.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.360411 18508 tablet_service.cc:1511] Processing CreateTablet for tablet 839b054b585245fba5afad723631f5a8 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:28.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.366565 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b054b585245fba5afad723631f5a8. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.370185 18507 tablet_service.cc:1511] Processing CreateTablet for tablet 54b30bbe4a894b06a23047368562c89d (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.371706 18507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b30bbe4a894b06a23047368562c89d. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.375805 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 54b30bbe4a894b06a23047368562c89d (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:28.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.374869 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 242759f5dd6f4ed58bd66f1fb43eab52 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:28.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.379370 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242759f5dd6f4ed58bd66f1fb43eab52. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.380466 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b30bbe4a894b06a23047368562c89d. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.383297 18506 tablet_service.cc:1511] Processing CreateTablet for tablet 242759f5dd6f4ed58bd66f1fb43eab52 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.384521 18506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242759f5dd6f4ed58bd66f1fb43eab52. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.382302 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 839b054b585245fba5afad723631f5a8 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.388717 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b054b585245fba5afad723631f5a8. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.431608 18646 tablet_service.cc:1511] Processing CreateTablet for tablet 242759f5dd6f4ed58bd66f1fb43eab52 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:28.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.437022 18646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242759f5dd6f4ed58bd66f1fb43eab52. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.434922 18647 tablet_service.cc:1511] Processing CreateTablet for tablet 54b30bbe4a894b06a23047368562c89d (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:28.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.439064 18647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b30bbe4a894b06a23047368562c89d. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.437815 18648 tablet_service.cc:1511] Processing CreateTablet for tablet 839b054b585245fba5afad723631f5a8 (DEFAULT_TABLE table=replication_test_table [id=bcb23d64ff464dda9c329f206be68c10]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.445269 18648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839b054b585245fba5afad723631f5a8. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.463263 19610 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Bootstrap starting.
14:25:28.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.478045 19610 tablet_bootstrap.cc:654] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Neither blocks nor log segments found. Creating new log.
14:25:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.481593 19611 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Bootstrap starting.
14:25:28.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.485004 19610 log.cc:826] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Log is configured to *not* fsync() on all Append() calls
14:25:28.503 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:28.503 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:28.504 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:28.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.504 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.504 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.504 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.505 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:28.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.506291 19610 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: No bootstrap required, opened a new log
14:25:28.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.506860 19610 ts_tablet_manager.cc:1403] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.011s
14:25:28.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.506832 19611 tablet_bootstrap.cc:654] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Neither blocks nor log segments found. Creating new log.
14:25:28.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.510768 19611 log.cc:826] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Log is configured to *not* fsync() on all Append() calls
14:25:28.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.529397 19611 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: No bootstrap required, opened a new log
14:25:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.529918 19611 ts_tablet_manager.cc:1403] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.015s
14:25:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.529950 19613 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Bootstrap starting.
14:25:28.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:28.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:28.535 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:28.535 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.535 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.535 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.536 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.536 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.536 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.536 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.536 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:28.548 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:28.548 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:28.548 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:28.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.549 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.549 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.549 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.549 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.549 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.549 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:28.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.564855 19611 raft_consensus.cc:359] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.565738 19611 raft_consensus.cc:385] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.566051 19611 raft_consensus.cc:740] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ca421182684bf0990b55aa3bef06fc, State: Initialized, Role: FOLLOWER
14:25:28.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.567029 19611 consensus_queue.cc:260] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.568743 19613 tablet_bootstrap.cc:654] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Neither blocks nor log segments found. Creating new log.
14:25:28.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.580730 19613 log.cc:826] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Log is configured to *not* fsync() on all Append() calls
14:25:28.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.606171 19613 tablet_bootstrap.cc:492] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: No bootstrap required, opened a new log
14:25:28.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.606748 19613 ts_tablet_manager.cc:1403] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Time spent bootstrapping tablet: real 0.078s	user 0.000s	sys 0.016s
14:25:28.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.614557 19611 ts_tablet_manager.cc:1434] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Time spent starting tablet: real 0.084s	user 0.042s	sys 0.033s
14:25:28.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.618960 19610 raft_consensus.cc:359] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.619881 19610 raft_consensus.cc:385] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.621443 19610 raft_consensus.cc:740] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c5a90a953ad4b5681643a81a5370633, State: Initialized, Role: FOLLOWER
14:25:28.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.625195 19610 consensus_queue.cc:260] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.646355 19610 ts_tablet_manager.cc:1434] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Time spent starting tablet: real 0.139s	user 0.032s	sys 0.001s
14:25:28.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.653642 19610 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633: Bootstrap starting.
14:25:28.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.667451 19611 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc: Bootstrap starting.
14:25:28.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.674084 19617 raft_consensus.cc:493] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:28.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.681068 19617 raft_consensus.cc:515] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.691578 19611 tablet_bootstrap.cc:654] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc: Neither blocks nor log segments found. Creating new log.
14:25:28.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:28.692701 18580 tablet.cc:2404] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:28.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.702735 19611 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc: No bootstrap required, opened a new log
14:25:28.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.703120 19611 ts_tablet_manager.cc:1403] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
14:25:28.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.703783 19610 tablet_bootstrap.cc:654] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633: Neither blocks nor log segments found. Creating new log.
14:25:28.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.705741 19611 raft_consensus.cc:359] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.706370 19611 raft_consensus.cc:385] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.709844 19617 leader_election.cc:290] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:28.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.708719 19611 raft_consensus.cc:740] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ca421182684bf0990b55aa3bef06fc, State: Initialized, Role: FOLLOWER
14:25:28.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.718181 19611 consensus_queue.cc:260] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.729624 19610 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633: No bootstrap required, opened a new log
14:25:28.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.730193 19610 ts_tablet_manager.cc:1403] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.012s
14:25:28.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.735661 19610 raft_consensus.cc:359] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.736420 19610 raft_consensus.cc:385] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.736771 19610 raft_consensus.cc:740] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c5a90a953ad4b5681643a81a5370633, State: Initialized, Role: FOLLOWER
14:25:28.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:28.737140 18381 tablet.cc:2404] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:28.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.738652 19610 consensus_queue.cc:260] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.739754 19611 ts_tablet_manager.cc:1434] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
14:25:28.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.743294 19611 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc: Bootstrap starting.
14:25:28.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.743618 19610 ts_tablet_manager.cc:1434] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
14:25:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.744405 19610 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633: Bootstrap starting.
14:25:28.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.755568 19613 raft_consensus.cc:359] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.757266 19613 raft_consensus.cc:385] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.758869 19613 raft_consensus.cc:740] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be049df38da4388a5d46d454e4d7e92, State: Initialized, Role: FOLLOWER
14:25:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.759507 19610 tablet_bootstrap.cc:654] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633: Neither blocks nor log segments found. Creating new log.
14:25:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.760900 19611 tablet_bootstrap.cc:654] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc: Neither blocks nor log segments found. Creating new log.
14:25:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.760104 19613 consensus_queue.cc:260] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.770238 19615 raft_consensus.cc:493] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:28.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.770802 19615 raft_consensus.cc:515] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.771376 19613 ts_tablet_manager.cc:1434] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Time spent starting tablet: real 0.164s	user 0.030s	sys 0.007s
14:25:28.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.772599 19613 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92: Bootstrap starting.
14:25:28.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.780136 19613 tablet_bootstrap.cc:654] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92: Neither blocks nor log segments found. Creating new log.
14:25:28.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.801843 19613 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92: No bootstrap required, opened a new log
14:25:28.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.802366 19613 ts_tablet_manager.cc:1403] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.019s
14:25:28.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.806703 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc" is_pre_election: true
14:25:28.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.807554 18528 raft_consensus.cc:2468] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 0.
14:25:28.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:28.809826 18718 tablet.cc:2404] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.812808 19615 leader_election.cc:290] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479), 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201)
14:25:28.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.814029 18251 leader_election.cc:304] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c5a90a953ad4b5681643a81a5370633, c6ca421182684bf0990b55aa3bef06fc; no voters: 
14:25:28.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.815513 19617 raft_consensus.cc:2804] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:28.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.815851 19617 raft_consensus.cc:493] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.816177 19617 raft_consensus.cc:3060] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Advancing to term 1
14:25:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.816911 19613 raft_consensus.cc:359] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.817557 19613 raft_consensus.cc:385] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.817894 19613 raft_consensus.cc:740] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be049df38da4388a5d46d454e4d7e92, State: Initialized, Role: FOLLOWER
14:25:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.818578 19613 consensus_queue.cc:260] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.825934 19617 raft_consensus.cc:515] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.827661 19610 tablet_bootstrap.cc:492] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633: No bootstrap required, opened a new log
14:25:28.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.828052 19610 ts_tablet_manager.cc:1403] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.005s
14:25:28.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.832015 19617 leader_election.cc:290] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Requested vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:28.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.832687 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:28.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.833176 18528 raft_consensus.cc:3060] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Advancing to term 1
14:25:28.846 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:28.846 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:28.846 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:28.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.842504 18528 raft_consensus.cc:2468] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 1.
14:25:28.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.846073 19611 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc: No bootstrap required, opened a new log
14:25:28.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.846438 19611 ts_tablet_manager.cc:1403] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.002s
14:25:28.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:28.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:28.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:28.848 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.846961 18251 leader_election.cc:304] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c5a90a953ad4b5681643a81a5370633, c6ca421182684bf0990b55aa3bef06fc; no voters: 
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.848829 19617 raft_consensus.cc:2804] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Leader election won for term 1
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.849403 19617 raft_consensus.cc:697] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [term 1 LEADER]: Becoming Leader. State: Replica: 4c5a90a953ad4b5681643a81a5370633, State: Running, Role: LEADER
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.849257 19611 raft_consensus.cc:359] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.850298 19611 raft_consensus.cc:385] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.850589 19611 raft_consensus.cc:740] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ca421182684bf0990b55aa3bef06fc, State: Initialized, Role: FOLLOWER
14:25:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.850294 19617 consensus_queue.cc:237] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } }
14:25:28.854 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:28.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.851189 19611 consensus_queue.cc:260] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.855 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.855 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:28.855 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:28.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.856 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.856 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:28.856 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:28.856 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.856511 19611 ts_tablet_manager.cc:1434] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
14:25:28.856 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.856 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:28.856 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.865320 19610 raft_consensus.cc:359] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.875483 18120 catalog_manager.cc:5697] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1). New cstate: current_term: 1 leader_uuid: "4c5a90a953ad4b5681643a81a5370633" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } health_report { overall_health: HEALTHY } } }
14:25:28.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:28.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.865923 19610 raft_consensus.cc:385] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:28.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.899863 19610 raft_consensus.cc:740] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c5a90a953ad4b5681643a81a5370633, State: Initialized, Role: FOLLOWER
14:25:28.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.911105 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92" is_pre_election: true
14:25:28.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.911979 18668 raft_consensus.cc:2468] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 0.
14:25:28.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.913549 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:28.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.914096 18668 raft_consensus.cc:3060] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Advancing to term 1
14:25:28.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.926290 18320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c5a90a953ad4b5681643a81a5370633" is_pre_election: true
14:25:28.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.927014 18668 raft_consensus.cc:2468] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 1.
14:25:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.905402 19610 consensus_queue.cc:260] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:28.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.947033 19610 ts_tablet_manager.cc:1434] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
14:25:28.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.949815 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839b054b585245fba5afad723631f5a8" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92" is_pre_election: true
14:25:28.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.950608 18668 raft_consensus.cc:2393] T 839b054b585245fba5afad723631f5a8 P 4be049df38da4388a5d46d454e4d7e92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6ca421182684bf0990b55aa3bef06fc in current term 1: Already voted for candidate 4c5a90a953ad4b5681643a81a5370633 in this term.
14:25:28.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.953543 18461 leader_election.cc:304] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6ca421182684bf0990b55aa3bef06fc; no voters: 4be049df38da4388a5d46d454e4d7e92, 4c5a90a953ad4b5681643a81a5370633
14:25:28.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.955102 19615 raft_consensus.cc:2749] T 839b054b585245fba5afad723631f5a8 P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:25:28.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:28.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:28.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:28.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:28.968 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.968 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.968 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:28.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:28.969 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.997223 19613 ts_tablet_manager.cc:1434] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92: Time spent starting tablet: real 0.194s	user 0.029s	sys 0.020s
14:25:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:28.998401 19613 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92: Bootstrap starting.
14:25:29.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.031190 19613 tablet_bootstrap.cc:654] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92: Neither blocks nor log segments found. Creating new log.
14:25:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.046098 19613 tablet_bootstrap.cc:492] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92: No bootstrap required, opened a new log
14:25:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.046510 19613 ts_tablet_manager.cc:1403] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
14:25:29.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.049014 19613 raft_consensus.cc:359] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.049624 19613 raft_consensus.cc:385] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:29.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.049893 19613 raft_consensus.cc:740] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be049df38da4388a5d46d454e4d7e92, State: Initialized, Role: FOLLOWER
14:25:29.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.050541 19613 consensus_queue.cc:260] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.052999 19613 ts_tablet_manager.cc:1434] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
14:25:29.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.059511 19578 heartbeater.cc:499] Master 127.18.72.252:44649 was elected leader, sending a full tablet report...
14:25:29.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.063778 19615 raft_consensus.cc:493] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:29.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.064229 19615 raft_consensus.cc:515] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.066043 19615 leader_election.cc:290] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.066717 18320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c5a90a953ad4b5681643a81a5370633" is_pre_election: true
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.067329 18320 raft_consensus.cc:2468] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ca421182684bf0990b55aa3bef06fc in term 0.
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.067766 19617 raft_consensus.cc:493] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.068187 19617 raft_consensus.cc:515] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.068787 18462 leader_election.cc:304] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c5a90a953ad4b5681643a81a5370633, c6ca421182684bf0990b55aa3bef06fc; no voters: 
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.069566 19615 raft_consensus.cc:2804] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.070086 19617 leader_election.cc:290] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.070371 19615 raft_consensus.cc:493] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.070680 19615 raft_consensus.cc:3060] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Advancing to term 1
14:25:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.072100 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc" is_pre_election: true
14:25:29.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.074996 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92" is_pre_election: true
14:25:29.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.075733 18667 raft_consensus.cc:2468] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 0.
14:25:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.076969 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92" is_pre_election: true
14:25:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.077492 18668 raft_consensus.cc:2468] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ca421182684bf0990b55aa3bef06fc in term 0.
14:25:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.078092 19615 raft_consensus.cc:515] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.079322 18528 raft_consensus.cc:2393] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c5a90a953ad4b5681643a81a5370633 in current term 1: Already voted for candidate c6ca421182684bf0990b55aa3bef06fc in this term.
14:25:29.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.080431 18251 leader_election.cc:304] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be049df38da4388a5d46d454e4d7e92, 4c5a90a953ad4b5681643a81a5370633; no voters: 
14:25:29.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.081200 19617 raft_consensus.cc:2804] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:29.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.081513 19617 raft_consensus.cc:493] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:29.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.081802 19617 raft_consensus.cc:3060] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Advancing to term 1
14:25:29.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.083375 19615 leader_election.cc:290] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 election: Requested vote from peers 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1:37201), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.084045 18320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c5a90a953ad4b5681643a81a5370633"
14:25:29.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.085685 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "c6ca421182684bf0990b55aa3bef06fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:29.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.086275 18667 raft_consensus.cc:3060] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Advancing to term 1
14:25:29.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.091753 19618 raft_consensus.cc:493] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:29.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.092211 19618 raft_consensus.cc:515] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.093855 19618 leader_election.cc:290] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.093725 19617 raft_consensus.cc:515] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.094946 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b30bbe4a894b06a23047368562c89d" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc" is_pre_election: true
14:25:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.094945 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b30bbe4a894b06a23047368562c89d" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92" is_pre_election: true
14:25:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.095528 18668 raft_consensus.cc:2468] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 0.
14:25:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.095516 18528 raft_consensus.cc:2468] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 0.
14:25:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.096499 18251 leader_election.cc:304] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be049df38da4388a5d46d454e4d7e92, 4c5a90a953ad4b5681643a81a5370633; no voters: 
14:25:29.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.097178 19618 raft_consensus.cc:2804] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:29.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.097496 19618 raft_consensus.cc:493] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:29.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.097805 19618 raft_consensus.cc:3060] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 0 FOLLOWER]: Advancing to term 1
14:25:29.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.097851 18667 raft_consensus.cc:2468] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ca421182684bf0990b55aa3bef06fc in term 1.
14:25:29.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.098765 18461 leader_election.cc:304] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be049df38da4388a5d46d454e4d7e92, c6ca421182684bf0990b55aa3bef06fc; no voters: 
14:25:29.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.102133 19615 raft_consensus.cc:2804] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Leader election won for term 1
14:25:29.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.104175 19618 raft_consensus.cc:515] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.107355 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b30bbe4a894b06a23047368562c89d" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:29.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.107933 18528 raft_consensus.cc:3060] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 0 FOLLOWER]: Advancing to term 1
14:25:29.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.110405 18320 raft_consensus.cc:2393] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6ca421182684bf0990b55aa3bef06fc in current term 1: Already voted for candidate 4c5a90a953ad4b5681643a81a5370633 in this term.
14:25:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.114106 19617 leader_election.cc:290] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Requested vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.115017 18527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ca421182684bf0990b55aa3bef06fc"
14:25:29.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.118142 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b30bbe4a894b06a23047368562c89d" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:29.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.118309 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242759f5dd6f4ed58bd66f1fb43eab52" candidate_uuid: "4c5a90a953ad4b5681643a81a5370633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4be049df38da4388a5d46d454e4d7e92"
14:25:29.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.118825 18668 raft_consensus.cc:3060] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 0 FOLLOWER]: Advancing to term 1
14:25:29.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.119040 18667 raft_consensus.cc:2393] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4be049df38da4388a5d46d454e4d7e92 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c5a90a953ad4b5681643a81a5370633 in current term 1: Already voted for candidate c6ca421182684bf0990b55aa3bef06fc in this term.
14:25:29.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.127574 19618 leader_election.cc:290] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Requested vote from peers c6ca421182684bf0990b55aa3bef06fc (127.17.128.2:44563), 4be049df38da4388a5d46d454e4d7e92 (127.17.128.3:42479)
14:25:29.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.127283 18668 raft_consensus.cc:2468] T 54b30bbe4a894b06a23047368562c89d P 4be049df38da4388a5d46d454e4d7e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 1.
14:25:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.130317 18251 leader_election.cc:304] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be049df38da4388a5d46d454e4d7e92, 4c5a90a953ad4b5681643a81a5370633; no voters: 
14:25:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.131538 19618 raft_consensus.cc:2804] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Leader election won for term 1
14:25:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.132736 19618 raft_consensus.cc:697] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [term 1 LEADER]: Becoming Leader. State: Replica: 4c5a90a953ad4b5681643a81a5370633, State: Running, Role: LEADER
14:25:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.133285 18528 raft_consensus.cc:2468] T 54b30bbe4a894b06a23047368562c89d P c6ca421182684bf0990b55aa3bef06fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c5a90a953ad4b5681643a81a5370633 in term 1.
14:25:29.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.134244 19618 consensus_queue.cc:237] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.141857 19615 raft_consensus.cc:697] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [term 1 LEADER]: Becoming Leader. State: Replica: c6ca421182684bf0990b55aa3bef06fc, State: Running, Role: LEADER
14:25:29.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.142990 19615 consensus_queue.cc:237] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } }
14:25:29.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.155124 18120 catalog_manager.cc:5697] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c5a90a953ad4b5681643a81a5370633 (127.17.128.1). New cstate: current_term: 1 leader_uuid: "4c5a90a953ad4b5681643a81a5370633" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } health_report { overall_health: UNKNOWN } } }
14:25:29.180 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:29.180 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:29.180 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:29.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.182 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.182 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.182 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.182 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.191442 18251 leader_election.cc:304] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c5a90a953ad4b5681643a81a5370633; no voters: 4be049df38da4388a5d46d454e4d7e92, c6ca421182684bf0990b55aa3bef06fc
14:25:29.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.192703 19618 raft_consensus.cc:2749] T 242759f5dd6f4ed58bd66f1fb43eab52 P 4c5a90a953ad4b5681643a81a5370633 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
14:25:29.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.193599 18120 catalog_manager.cc:5697] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ca421182684bf0990b55aa3bef06fc (127.17.128.2). New cstate: current_term: 1 leader_uuid: "c6ca421182684bf0990b55aa3bef06fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 } health_report { overall_health: UNKNOWN } } }
14:25:29.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.237902 19618 consensus_queue.cc:1048] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.272264 19618 consensus_queue.cc:1048] T 839b054b585245fba5afad723631f5a8 P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.454 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:29.455 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:29.455 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:29.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:29.514 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:29.514 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:29.514 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:29.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.515 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:29.546 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:29.546 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:29.546 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:29.546 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:29.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:29.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:29.547 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:29.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.561838 19615 consensus_queue.cc:1048] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.587211 19615 consensus_queue.cc:1048] T 242759f5dd6f4ed58bd66f1fb43eab52 P c6ca421182684bf0990b55aa3bef06fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c5a90a953ad4b5681643a81a5370633" member_type: VOTER last_known_addr { host: "127.17.128.1" port: 37201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.609210 19647 consensus_queue.cc:1048] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4be049df38da4388a5d46d454e4d7e92" member_type: VOTER last_known_addr { host: "127.17.128.3" port: 42479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:29.624732 19618 consensus_queue.cc:1048] T 54b30bbe4a894b06a23047368562c89d P 4c5a90a953ad4b5681643a81a5370633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ca421182684bf0990b55aa3bef06fc" member_type: VOTER last_known_addr { host: "127.17.128.2" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:29.629 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.803 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:29.804 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:29.804 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:29.804 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.804 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.804 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:29.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:29.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:29.805 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:29.863 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:29.863 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:29.863 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:29.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:29.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:29.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:29.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:29.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:29.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:29.864 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:29.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:29.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:29.864 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:29.866 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:29.866 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:29.867 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:29.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.867 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:29.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:29.939 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:29.939 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:29.939 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:29.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:29.940 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:29.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:29.940 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:29.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:29.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:29.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:29.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:29.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:29.940 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:29.987 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:29.988 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:29.988 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:29.988 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.988 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.988 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:29.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:29.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:29.989 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:30.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.163 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:30.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 839b054b585245fba5afad723631f5a8 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:30.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 54b30bbe4a894b06a23047368562c89d for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:30.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 242759f5dd6f4ed58bd66f1fb43eab52 for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:30.167 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:30.167 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.17.128.60:42293, [3ms] Sub RPC GetTableLocations: received response from server master-127.17.128.60:42293: OK, deferred=null) after lookup
14:25:30.167 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)] connecting to peer
14:25:30.168 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)] Successfully connected to peer
14:25:30.178 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.180 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x6832cce4, L:/127.0.0.1:50020 - R:/127.17.128.1:37201] using TOKEN/null
14:25:30.289 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:30.289 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:30.289 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:30.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.290 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.290 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.290 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.290 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.290 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.290 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:30.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.417 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:30.418 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:30.426 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:30.427 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:30.427 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:30.430 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:30.430 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:30.431 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:30.431 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:30.446 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:30.456 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.460 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb4854fdd, L:/127.0.0.1:58014 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:30.464 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:30.469 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.473 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xebe136b7, L:/127.0.0.1:53742 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:30.476 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:30.476 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=57), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [37ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [50ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:30.479 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.480 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:30.481 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:30.482 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa64f230f, L:/127.0.0.1:34866 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:30.490 [DEBUG - main] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:30.492 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.128.62:37019(127.17.128.62:37019)] Successfully connected to peer
14:25:30.496 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:30.497 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:30.497 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:30.497 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.497 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.128.60:42293(127.17.128.60:42293)] Successfully connected to peer
14:25:30.498 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.498 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.498 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:30.498 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.498 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.498 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:30.490 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.128.61:34199(127.17.128.61:34199)] Successfully connected to peer
14:25:30.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:30.498 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:30.502 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.62
14:25:30.506 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.60
14:25:30.507 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.61
14:25:30.511 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.514 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x36e5d98a, L:/127.0.0.1:32804 - R:/127.17.128.62:37019] using SASL/PLAIN
14:25:30.515 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.516 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:30.518 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xdedab177, L:/127.0.0.1:37336 - R:/127.17.128.61:34199] using SASL/PLAIN
14:25:30.520 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xed462c63, L:/127.0.0.1:54598 - R:/127.17.128.60:42293] using SASL/PLAIN
14:25:30.523 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:30.523 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:30.523 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:30.523 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:30.523 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=44), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [37ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: OK, deferred=null) after lookup
14:25:30.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:30.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:30.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:30.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:30.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:30.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:30.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:30.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:30.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:30.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:30.527 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:30.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 839b054b585245fba5afad723631f5a8 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:30.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 54b30bbe4a894b06a23047368562c89d for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:30.531 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 242759f5dd6f4ed58bd66f1fb43eab52 for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:30.531 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.533123 18985 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53742:
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:30.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\001d\000\000\000"
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:25:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:30.536275 18985 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:25:30.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:30.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.692577 19370 tablet_service.cc:1511] Processing CreateTablet for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:30.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.694502 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:30.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.703574 19164 tablet_service.cc:1511] Processing CreateTablet for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:30.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.702986 19512 tablet_service.cc:1511] Processing CreateTablet for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION VALUES < 100
14:25:30.707 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:30.708 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:30.708 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:30.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:30.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:30.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:30.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:30.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:30.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.706848 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:30.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.707053 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:30.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:30.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:30.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:30.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:30.709 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.774149 19700 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Bootstrap starting.
14:25:30.779 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:30.780 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:30.780 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:30.780 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:30.780 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:30.781 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:30.781 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:30.781 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:30.781 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:30.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:30.782 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:30.782 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:30.782 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:30.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.785315 19700 tablet_bootstrap.cc:654] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Neither blocks nor log segments found. Creating new log.
14:25:30.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.787436 19700 log.cc:826] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Log is configured to *not* fsync() on all Append() calls
14:25:30.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.789669 19701 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Bootstrap starting.
14:25:30.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.791316 19702 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Bootstrap starting.
14:25:30.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.800289 19701 tablet_bootstrap.cc:654] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Neither blocks nor log segments found. Creating new log.
14:25:30.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.802591 19701 log.cc:826] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Log is configured to *not* fsync() on all Append() calls
14:25:30.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.817528 19700 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: No bootstrap required, opened a new log
14:25:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.818109 19700 ts_tablet_manager.cc:1403] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.006s
14:25:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.819159 19701 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: No bootstrap required, opened a new log
14:25:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.819633 19701 ts_tablet_manager.cc:1403] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.009s
14:25:30.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.827371 19702 tablet_bootstrap.cc:654] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Neither blocks nor log segments found. Creating new log.
14:25:30.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.834065 19702 log.cc:826] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Log is configured to *not* fsync() on all Append() calls
14:25:30.843 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:30.843 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:30.843 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:30.843 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:30.843 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:30.843 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:30.843 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:30.843 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:30.844 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:30.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:30.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:30.844 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:30.844 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.848362 19702 tablet_bootstrap.cc:492] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: No bootstrap required, opened a new log
14:25:30.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.848986 19702 ts_tablet_manager.cc:1403] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.006s
14:25:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.854741 19701 raft_consensus.cc:359] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.855424 19701 raft_consensus.cc:385] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.855665 19701 raft_consensus.cc:740] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, State: Initialized, Role: FOLLOWER
14:25:30.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.856590 19701 consensus_queue.cc:260] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.866077 19701 ts_tablet_manager.cc:1434] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent starting tablet: real 0.046s	user 0.029s	sys 0.008s
14:25:30.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.876 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:30.876 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:30.876 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:30.878 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:30.878 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:30.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:30.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:30.879 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:30.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:30.879 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:30.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:30.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:30.879 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:30.879 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:30.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.888762 19700 raft_consensus.cc:359] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.891597 19700 raft_consensus.cc:385] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:30.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.892231 19700 raft_consensus.cc:740] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6420fff486b542d4af7311f720e1b3b3, State: Initialized, Role: FOLLOWER
14:25:30.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.895771 19700 consensus_queue.cc:260] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.913496 19702 raft_consensus.cc:359] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.915871 19702 raft_consensus.cc:385] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:30.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.917024 19702 raft_consensus.cc:740] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46e3ac247443b18c01517e6b29eeab, State: Initialized, Role: FOLLOWER
14:25:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.918397 19702 consensus_queue.cc:260] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.940665 19702 ts_tablet_manager.cc:1434] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Time spent starting tablet: real 0.090s	user 0.024s	sys 0.012s
14:25:30.943 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:30.944 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:30.944 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:30.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:30.944 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:30.944 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:30.944 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:30.944 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:30.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:30.944 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:30.945 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:30.945 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:30.945 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:30.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.950176 19708 raft_consensus.cc:493] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:30.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.955205 19708 raft_consensus.cc:515] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.960426 19700 ts_tablet_manager.cc:1434] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Time spent starting tablet: real 0.142s	user 0.030s	sys 0.008s
14:25:30.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.974452 19708 leader_election.cc:290] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669)
14:25:30.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.984937 19709 raft_consensus.cc:493] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:30.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.985728 19709 raft_consensus.cc:515] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:30.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:30.992636 19709 leader_election.cc:290] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:31.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.021169 19443 tablet.cc:2404] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:31.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.023799 19391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" is_pre_election: true
14:25:31.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.024605 19391 raft_consensus.cc:2468] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6420fff486b542d4af7311f720e1b3b3 in term 0.
14:25:31.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.024921 19390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" is_pre_election: true
14:25:31.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.025458 19584 tablet.cc:2404] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:31.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.025569 19390 raft_consensus.cc:2468] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 0.
14:25:31.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.026360 19468 leader_election.cc:304] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, 6420fff486b542d4af7311f720e1b3b3; no voters: 
14:25:31.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.026880 19120 leader_election.cc:304] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d46e3ac247443b18c01517e6b29eeab, 4d16dcc0d1ea41e1b3b0ed5ecc272af2; no voters: 
14:25:31.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.027781 19709 raft_consensus.cc:2804] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:31.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.028218 19709 raft_consensus.cc:493] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:31.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.028434 19708 raft_consensus.cc:2804] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:31.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.028601 19709 raft_consensus.cc:3060] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Advancing to term 1
14:25:31.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.028793 19708 raft_consensus.cc:493] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:31.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.029157 19708 raft_consensus.cc:3060] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.035838 19709 raft_consensus.cc:515] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:31.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.037223 19708 raft_consensus.cc:515] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.037591 19709 leader_election.cc:290] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 election: Requested vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:31.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.039566 19390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:31.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.040081 19390 raft_consensus.cc:3060] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.040373 19391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.043402 19532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6420fff486b542d4af7311f720e1b3b3" is_pre_election: true
14:25:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.044335 19532 raft_consensus.cc:2393] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d46e3ac247443b18c01517e6b29eeab in current term 1: Already voted for candidate 6420fff486b542d4af7311f720e1b3b3 in this term.
14:25:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.045606 19531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6420fff486b542d4af7311f720e1b3b3"
14:25:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.046408 19531 raft_consensus.cc:2393] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d46e3ac247443b18c01517e6b29eeab in current term 1: Already voted for candidate 6420fff486b542d4af7311f720e1b3b3 in this term.
14:25:31.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.048228 19390 raft_consensus.cc:2468] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 1.
14:25:31.049 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:31.049 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:31.050 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:31.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.050 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.049365 19120 leader_election.cc:304] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d46e3ac247443b18c01517e6b29eeab, 4d16dcc0d1ea41e1b3b0ed5ecc272af2; no voters: 6420fff486b542d4af7311f720e1b3b3
14:25:31.050 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.050 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.050 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.050 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.050 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.050 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.050642 19709 raft_consensus.cc:2804] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 1 FOLLOWER]: Leader election won for term 1
14:25:31.051 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:31.051 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=27085), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [8ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [10ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [10ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [11ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [26ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [27ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [28ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [223ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [223ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [323ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [324ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [462ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [463ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [463ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [463ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2003ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [5201ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@1012167110(state=PENDING, result=null, callback=(continuation of Deferred@1622164041 after retry RPC after error@1391617830) -> (continuation of Deferred@170185301 after retry RPC after error@367085718) -> (continuation of Deferred@2007097961 after retry RPC after error@908812524) -> (continuation of Deferred@447855110 after retry RPC after error@84669502) -> (continuation of Deferred@2101476444 after retry RPC after error@276881176) -> (continuation of Deferred@133572228 after retry RPC after error@1569101888) -> (continuation of Deferred@794242224 after retry RPC after error@968445533) -> (continuation of Deferred@256744936 after retry RPC after error@1717588185) -> (continuation of Deferred@1891947017 after retry RPC after error@58503658) -> (continuation of Deferred@1614663344 after retry RPC after error@71281910) -> (continuation of Deferred@1379754722 after retry RPC after error@875068078) -> (continuation of Deferred@980314837 after retry RPC after error@1137654130) -> (continuation of Deferred@2052876699 after retry RPC after error@223773044) -> (continuation of Deferred@1151826633 after retry RPC after error@2124009350) -> (continuation of Deferred@1737519487 after retry RPC after error@1584665048) -> (continuation of Deferred@570055149 after retry RPC after error@288315307) -> (continuation of Deferred@1968232312 after retry RPC after error@190112475) -> (continuation of Deferred@2014504813 after retry RPC after error@325809611) -> (continuation of Deferred@1626577865 after retry RPC after error@1277034294), errback=(continuation of Deferred@1622164041 after retry RPC after error@1391617830) -> (continuation of Deferred@170185301 after retry RPC after error@367085718) -> (continuation of Deferred@2007097961 after retry RPC after error@908812524) -> (continuation of Deferred@447855110 after retry RPC after error@84669502) -> (continuation of Deferred@2101476444 after retry RPC after error@276881176) -> (continuation of Deferred@133572228 after retry RPC after error@1569101888) -> (continuation of Deferred@794242224 after retry RPC after error@968445533) -> (continuation of Deferred@256744936 after retry RPC after error@1717588185) -> (continuation of Deferred@1891947017 after retry RPC after error@58503658) -> (continuation of Deferred@1614663344 after retry RPC after error@71281910) -> (continuation of Deferred@1379754722 after retry RPC after error@875068078) -> (continuation of Deferred@980314837 after retry RPC after error@1137654130) -> (continuation of Deferred@2052876699 after retry RPC after error@223773044) -> (continuation of Deferred@1151826633 after retry RPC after error@2124009350) -> (continuation of Deferred@1737519487 after retry RPC after error@1584665048) -> (continuation of Deferred@570055149 after retry RPC after error@288315307) -> (continuation of Deferred@1968232312 after retry RPC after error@190112475) -> (continuation of Deferred@2014504813 after retry RPC after error@325809611) -> (continuation of Deferred@1626577865 after retry RPC after error@1277034294)))
14:25:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.051874 19708 leader_election.cc:290] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669)
14:25:31.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.057492 19709 raft_consensus.cc:697] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [term 1 LEADER]: Becoming Leader. State: Replica: 3d46e3ac247443b18c01517e6b29eeab, State: Running, Role: LEADER
14:25:31.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.058571 19709 consensus_queue.cc:237] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } }
14:25:31.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.063486 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d46e3ac247443b18c01517e6b29eeab" is_pre_election: true
14:25:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.065526 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0006cb8cdb4c57bb0c72e7ae0c41e4" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d46e3ac247443b18c01517e6b29eeab"
14:25:31.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.067030 19247 tablet.cc:2404] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:31.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.069341 19465 leader_election.cc:304] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6420fff486b542d4af7311f720e1b3b3; no voters: 3d46e3ac247443b18c01517e6b29eeab, 4d16dcc0d1ea41e1b3b0ed5ecc272af2
14:25:31.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.070125 19708 raft_consensus.cc:2749] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
14:25:31.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.084432 18985 catalog_manager.cc:5697] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193). New cstate: current_term: 1 leader_uuid: "3d46e3ac247443b18c01517e6b29eeab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } health_report { overall_health: HEALTHY } } }
14:25:31.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.194 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:31.194 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:31.194 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:31.195 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.196 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.310873 18985 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53742:
14:25:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
14:25:31.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.336262 18985 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea0fcf1a22234f0db9e31bb193bfcb0e has no consensus state
14:25:31.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.357214 19164 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fcf1a22234f0db9e31bb193bfcb0e (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:31.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.358490 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fcf1a22234f0db9e31bb193bfcb0e. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.359483 19370 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fcf1a22234f0db9e31bb193bfcb0e (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.360682 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fcf1a22234f0db9e31bb193bfcb0e. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.361501 19512 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fcf1a22234f0db9e31bb193bfcb0e (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
14:25:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.362663 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fcf1a22234f0db9e31bb193bfcb0e. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.369364 18971 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet ea0fcf1a22234f0db9e31bb193bfcb0e (table replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet ea0fcf1a22234f0db9e31bb193bfcb0e consensus state has no leader
14:25:31.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.379868 19701 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Bootstrap starting.
14:25:31.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.380105 19700 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3: Bootstrap starting.
14:25:31.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.386718 19701 tablet_bootstrap.cc:654] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Neither blocks nor log segments found. Creating new log.
14:25:31.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.390367 19700 tablet_bootstrap.cc:654] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3: Neither blocks nor log segments found. Creating new log.
14:25:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.392083 19702 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab: Bootstrap starting.
14:25:31.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.394014 19701 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: No bootstrap required, opened a new log
14:25:31.395 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:31.395 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:31.395 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:31.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.397 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.397 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.397 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.397 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:31.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.397543 19700 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3: No bootstrap required, opened a new log
14:25:31.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.397904 19700 ts_tablet_manager.cc:1403] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
14:25:31.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.397889 19701 ts_tablet_manager.cc:1403] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
14:25:31.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.398538 19702 tablet_bootstrap.cc:654] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab: Neither blocks nor log segments found. Creating new log.
14:25:31.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.399930 19700 raft_consensus.cc:359] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.400455 19700 raft_consensus.cc:385] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.400646 19700 raft_consensus.cc:740] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6420fff486b542d4af7311f720e1b3b3, State: Initialized, Role: FOLLOWER
14:25:31.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.401386 19700 consensus_queue.cc:260] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.402381 19701 raft_consensus.cc:359] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.403203 19701 raft_consensus.cc:385] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.403527 19700 ts_tablet_manager.cc:1434] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
14:25:31.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.403659 19701 raft_consensus.cc:740] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, State: Initialized, Role: FOLLOWER
14:25:31.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.404609 19701 consensus_queue.cc:260] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.406936 19701 ts_tablet_manager.cc:1434] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
14:25:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.412560 19708 raft_consensus.cc:493] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.412925 19708 raft_consensus.cc:515] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.414680 19708 leader_election.cc:290] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669), 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419)
14:25:31.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.416666 19390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fcf1a22234f0db9e31bb193bfcb0e" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" is_pre_election: true
14:25:31.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.416929 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fcf1a22234f0db9e31bb193bfcb0e" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d46e3ac247443b18c01517e6b29eeab" is_pre_election: true
14:25:31.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.417203 19390 raft_consensus.cc:2468] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6420fff486b542d4af7311f720e1b3b3 in term 0.
14:25:31.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.418557 19465 leader_election.cc:343] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669): Illegal state: must be running to vote when last-logged opid is not known
14:25:31.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.425489 19468 leader_election.cc:304] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, 6420fff486b542d4af7311f720e1b3b3; no voters: 3d46e3ac247443b18c01517e6b29eeab
14:25:31.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.432770 18985 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b] alter complete (version 0)
14:25:31.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.434979 19708 raft_consensus.cc:2804] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:31.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.435379 19708 raft_consensus.cc:493] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:31.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.435688 19708 raft_consensus.cc:3060] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.444200 19702 tablet_bootstrap.cc:492] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab: No bootstrap required, opened a new log
14:25:31.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.444635 19702 ts_tablet_manager.cc:1403] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.000s
14:25:31.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.445477 19708 raft_consensus.cc:515] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.447816 19702 raft_consensus.cc:359] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.448458 19702 raft_consensus.cc:385] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.448403 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fcf1a22234f0db9e31bb193bfcb0e" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d46e3ac247443b18c01517e6b29eeab"
14:25:31.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.448788 19702 raft_consensus.cc:740] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46e3ac247443b18c01517e6b29eeab, State: Initialized, Role: FOLLOWER
14:25:31.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.448899 19390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fcf1a22234f0db9e31bb193bfcb0e" candidate_uuid: "6420fff486b542d4af7311f720e1b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:31.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.449465 19390 raft_consensus.cc:3060] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.449544 19702 consensus_queue.cc:260] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.450475 19185 raft_consensus.cc:3060] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Advancing to term 1
14:25:31.454 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:31.454 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:31.454 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:31.454 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.454 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.454 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:31.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.456722 19185 raft_consensus.cc:2468] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6420fff486b542d4af7311f720e1b3b3 in term 1.
14:25:31.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.457293 19390 raft_consensus.cc:2468] T ea0fcf1a22234f0db9e31bb193bfcb0e P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6420fff486b542d4af7311f720e1b3b3 in term 1.
14:25:31.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.458340 19468 leader_election.cc:304] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, 6420fff486b542d4af7311f720e1b3b3; no voters: 
14:25:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.461086 19702 ts_tablet_manager.cc:1434] T ea0fcf1a22234f0db9e31bb193bfcb0e P 3d46e3ac247443b18c01517e6b29eeab: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
14:25:31.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.470772 18985 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53742:
14:25:31.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\310\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
14:25:31.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.472227 19722 raft_consensus.cc:2804] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Leader election won for term 1
14:25:31.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.479846 19708 leader_election.cc:290] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193:35669), 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419)
14:25:31.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.484933 19722 raft_consensus.cc:697] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 6420fff486b542d4af7311f720e1b3b3, State: Running, Role: LEADER
14:25:31.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.485934 19722 consensus_queue.cc:237] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.498 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:31.498 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:31.499 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:31.499 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.499 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.499 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:31.499 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.499 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.499 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:31.499 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.499 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.499 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:31.499 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:31.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.502205 18985 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea0fcf1a22234f0db9e31bb193bfcb0e consensus state has no leader
14:25:31.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:31.503437 18985 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edaa4198067a4dda9f9f12abacccee3a has no consensus state
14:25:31.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.506835 19709 consensus_queue.cc:1048] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:31.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.536975 19164 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4198067a4dda9f9f12abacccee3a (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:31.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.538164 18985 catalog_manager.cc:5697] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195). New cstate: current_term: 1 leader_uuid: "6420fff486b542d4af7311f720e1b3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } health_report { overall_health: HEALTHY } } }
14:25:31.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.543226 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4198067a4dda9f9f12abacccee3a. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.543550 19370 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4198067a4dda9f9f12abacccee3a (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:31.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.544703 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4198067a4dda9f9f12abacccee3a. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.547971 19512 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4198067a4dda9f9f12abacccee3a (DEFAULT_TABLE table=replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b]), partition=RANGE (key1) PARTITION 200 <= VALUES
14:25:31.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.549180 19512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4198067a4dda9f9f12abacccee3a. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:31.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.569285 19700 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3: Bootstrap starting.
14:25:31.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.570451 19701 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Bootstrap starting.
14:25:31.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.575026 19700 tablet_bootstrap.cc:654] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3: Neither blocks nor log segments found. Creating new log.
14:25:31.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.578348 19701 tablet_bootstrap.cc:654] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Neither blocks nor log segments found. Creating new log.
14:25:31.579 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:31.579 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:31.579 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:31.580 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:31.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:31.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:31.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:31.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:31.581 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:31.581 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:31.581 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:31.581 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:31.581 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:31.582 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:31.583 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:31.583 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:31.583 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.583 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.583 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:31.583 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.583 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.583 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:31.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:31.584 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.588388 19700 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3: No bootstrap required, opened a new log
14:25:31.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.588881 19700 ts_tablet_manager.cc:1403] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.006s
14:25:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.592276 19700 raft_consensus.cc:359] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.592976 19700 raft_consensus.cc:385] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.593253 19700 raft_consensus.cc:740] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6420fff486b542d4af7311f720e1b3b3, State: Initialized, Role: FOLLOWER
14:25:31.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.602095 19702 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab: Bootstrap starting.
14:25:31.604 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:31.605 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:31.605 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:31.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:31.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:31.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:31.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:31.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:31.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:31.606 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:31.606 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:31.606 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:31.606 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:31.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.612206 19702 tablet_bootstrap.cc:654] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab: Neither blocks nor log segments found. Creating new log.
14:25:31.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.612859 19701 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: No bootstrap required, opened a new log
14:25:31.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.613471 19701 ts_tablet_manager.cc:1403] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.001s
14:25:31.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.616600 19701 raft_consensus.cc:359] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.618898 19701 raft_consensus.cc:385] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.619401 19701 raft_consensus.cc:740] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d16dcc0d1ea41e1b3b0ed5ecc272af2, State: Initialized, Role: FOLLOWER
14:25:31.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.593885 19700 consensus_queue.cc:260] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.620822 19701 consensus_queue.cc:260] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.625432 19701 ts_tablet_manager.cc:1434] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
14:25:31.628 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.642019 19700 ts_tablet_manager.cc:1434] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3: Time spent starting tablet: real 0.053s	user 0.001s	sys 0.004s
14:25:31.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.650089 19702 tablet_bootstrap.cc:492] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab: No bootstrap required, opened a new log
14:25:31.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.650545 19702 ts_tablet_manager.cc:1403] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.003s
14:25:31.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.674072 19702 raft_consensus.cc:359] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.674878 19702 raft_consensus.cc:385] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:31.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.675208 19702 raft_consensus.cc:740] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d46e3ac247443b18c01517e6b29eeab, State: Initialized, Role: FOLLOWER
14:25:31.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.676272 19728 consensus_queue.cc:1048] T dc0006cb8cdb4c57bb0c72e7ae0c41e4 P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:25:31.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.680666 18986 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c2298ea5126a481ba3111caf1b59e630: replication_test_table [id=48ceed0eecfd45e9a649a4a94ba8809b] alter complete (version 0)
14:25:31.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.675951 19702 consensus_queue.cc:260] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.701347 19702 ts_tablet_manager.cc:1434] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
14:25:31.727 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:31.728 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:31.728 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:31.728 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.728 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.728 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:31.729 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.729 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.729 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:31.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:31.729 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:31.749 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.60:42293(127.17.128.60:42293)] disconnecting while in state READY
14:25:31.749 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.61:34199(127.17.128.61:34199)] disconnecting while in state READY
14:25:31.749 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.62:37019(127.17.128.62:37019)] disconnecting while in state READY
14:25:31.750 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.128.60:42293(127.17.128.60:42293)] handling channelInactive
14:25:31.750 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state READY due to: connection closed
14:25:31.751 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.128.61:34199(127.17.128.61:34199)] handling channelInactive
14:25:31.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state READY due to: connection closed
14:25:31.751 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:31.755 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:25:31.756 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
14:25:31.780 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.128.62:37019(127.17.128.62:37019)] handling channelInactive
14:25:31.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state READY due to: connection closed
14:25:31.780 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:25:31.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state READY
14:25:31.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state READY
14:25:31.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state READY
14:25:31.786 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:31.786 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:31.786 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:31.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:31.788 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:31.788 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
14:25:31.789 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
14:25:31.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.798084 19728 raft_consensus.cc:493] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:31.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.798573 19728 raft_consensus.cc:515] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.800623 19728 leader_election.cc:290] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:31.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.802515 19391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4198067a4dda9f9f12abacccee3a" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" is_pre_election: true
14:25:31.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.803162 19391 raft_consensus.cc:2468] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 0.
14:25:31.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.805459 19531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4198067a4dda9f9f12abacccee3a" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6420fff486b542d4af7311f720e1b3b3" is_pre_election: true
14:25:31.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.806136 19531 raft_consensus.cc:2468] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 0.
14:25:31.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.807580 19120 leader_election.cc:304] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d46e3ac247443b18c01517e6b29eeab, 4d16dcc0d1ea41e1b3b0ed5ecc272af2; no voters: 
14:25:31.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.809301 19728 raft_consensus.cc:2804] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:31.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.809623 19728 raft_consensus.cc:493] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:31.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.811450 19728 raft_consensus.cc:3060] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 0 FOLLOWER]: Advancing to term 1
14:25:31.826 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:31.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:31.827 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:25:31.828 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:25:31.829 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:25:31.829 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:25:31.829 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:25:31.829 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:25:31.829 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:25:31.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.826581 19728 raft_consensus.cc:515] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.839466 19728 leader_election.cc:290] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 election: Requested vote from peers 4d16dcc0d1ea41e1b3b0ed5ecc272af2 (127.18.72.194:41419), 6420fff486b542d4af7311f720e1b3b3 (127.18.72.195:46487)
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:25:31.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.840483 19391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4198067a4dda9f9f12abacccee3a" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2"
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:25:31.840 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:25:31.841 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:25:31.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.841024 19391 raft_consensus.cc:3060] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.844328 19531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4198067a4dda9f9f12abacccee3a" candidate_uuid: "3d46e3ac247443b18c01517e6b29eeab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6420fff486b542d4af7311f720e1b3b3"
14:25:31.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.844811 19531 raft_consensus.cc:3060] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 0 FOLLOWER]: Advancing to term 1
14:25:31.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.859109 19391 raft_consensus.cc:2468] T edaa4198067a4dda9f9f12abacccee3a P 4d16dcc0d1ea41e1b3b0ed5ecc272af2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 1.
14:25:31.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.860962 19120 leader_election.cc:304] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d46e3ac247443b18c01517e6b29eeab, 4d16dcc0d1ea41e1b3b0ed5ecc272af2; no voters: 
14:25:31.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.861639 19728 raft_consensus.cc:2804] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 1 FOLLOWER]: Leader election won for term 1
14:25:31.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.862042 19728 raft_consensus.cc:697] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [term 1 LEADER]: Becoming Leader. State: Replica: 3d46e3ac247443b18c01517e6b29eeab, State: Running, Role: LEADER
14:25:31.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.862682 19728 consensus_queue.cc:237] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } }
14:25:31.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.863617 19531 raft_consensus.cc:2468] T edaa4198067a4dda9f9f12abacccee3a P 6420fff486b542d4af7311f720e1b3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d46e3ac247443b18c01517e6b29eeab in term 1.
14:25:31.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.880 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:31.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.882969 18984 catalog_manager.cc:5697] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d46e3ac247443b18c01517e6b29eeab (127.18.72.193). New cstate: current_term: 1 leader_uuid: "3d46e3ac247443b18c01517e6b29eeab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 } health_report { overall_health: UNKNOWN } } }
14:25:31.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:31.968078 19722 consensus_queue.cc:1048] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d46e3ac247443b18c01517e6b29eeab" member_type: VOTER last_known_addr { host: "127.18.72.193" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:32.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:32.048673 19745 consensus_queue.cc:1048] T ea0fcf1a22234f0db9e31bb193bfcb0e P 6420fff486b542d4af7311f720e1b3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:32.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.210 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:25:32.228 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:32.228 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:32.229 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:32.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:32.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:32.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:32.230 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:32.230 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:32.230 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:32.230 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:32.230 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:32.230 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:32.230 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:32.275 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:25:32.275 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:25:32.275 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:25:32.288 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:25:32.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:32.370693 19709 consensus_queue.cc:1048] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d16dcc0d1ea41e1b3b0ed5ecc272af2" member_type: VOTER last_known_addr { host: "127.18.72.194" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:32.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:32.373075 19709 consensus_queue.cc:1048] T edaa4198067a4dda9f9f12abacccee3a P 3d46e3ac247443b18c01517e6b29eeab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6420fff486b542d4af7311f720e1b3b3" member_type: VOTER last_known_addr { host: "127.18.72.195" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:32.378 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.624 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:32.624 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:32.624 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:32.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:32.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:32.625 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:32.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:32.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:32.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:32.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:32.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:32.625 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:32.625 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:32.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.747 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:32.747 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:32.747 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:32.747 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:32.747 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:32.747 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:32.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:32.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:32.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:32.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:32.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:32.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:32.748 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:32.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:32.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.061 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
14:25:33.066 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:33.066 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:33.067 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:33.067 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.067 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.067 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.067 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:33.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.192 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:25:33.203 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:25:33.228 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:25:33.240 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:25:33.253 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:25:33.259 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:25:33.260 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:25:33.260 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:25:33.260 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:25:33.261 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:25:33.261 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:25:33.261 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:25:33.261 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:25:33.262 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:25:33.262 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:25:33.263 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:25:33.263 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:25:33.263 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:25:33.263 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:25:33.263 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:25:33.263 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:25:33.263 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:25:33.263 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:25:33.263 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:25:33.264 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:25:33.264 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:25:33.264 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:25:33.264 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:25:33.264 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:25:33.265 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_a80822da19c4729882693a293f42192e/blobStorage
14:25:33.265 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:40843 - max concurrent requests: 50 - max backlog: 1000
14:25:33.266 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_a80822da19c4729882693a293f42192e/blobStorage
14:25:33.266 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_a80822da19c4729882693a293f42192e/blobStorage
14:25:33.267 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:25:33.267 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 95249cf1-a357-42b1-9670-69fc4815c606
14:25:33.269 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
14:25:33.269 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-a8581fea-c5e4-42c3-b60a-b0c0e441d098
14:25:33.271 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-4ac1ec40-441e-4fe8-b166-842e8b67fa1d
14:25:33.327 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:25:33.328 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:25:33.328 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:25:33.328 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:25:33.329 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:25:33.330 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_16 .
14:25:33.336 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
14:25:33.336 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-0dd0ffbf-d848-4635-b45a-c53b507cc838
14:25:33.337 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:25:33.337 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:25:33.346 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:25:33.346 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:25:33.355 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:45051
14:25:33.355 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:25:33.356 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:45051 was granted leadership with leaderSessionID=25475f7a-c267-4655-82f5-6d487d18d9ad
14:25:33.356 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:45051 , session=25475f7a-c267-4655-82f5-6d487d18d9ad
14:25:33.357 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:25:33.357 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:25:33.357 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:25:33.357 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id ccaea123-5d84-4253-8395-134b06b1ba82. Creating new DispatcherLeaderProcess.
14:25:33.357 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:25:33.358 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:25:33.358 [INFO - pool-307-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id de1c97e5-1c6c-4600-9fc1-687bfe13474c.
14:25:33.358 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:25:33.358 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:25:33.360 [INFO - pool-307-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_17 .
14:25:33.362 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_18 .
14:25:33.362 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:33.363 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:33.363 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:33.363 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.363 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.363 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.364 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.364 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.364 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.364 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.364 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:33.367 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_18 , session=ccaea123-5d84-4253-8395-134b06b1ba82
14:25:33.368 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
14:25:33.369 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:25:33.369 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:25:33.369 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:25:33.370 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:25:33.370 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_17 , session=de1c97e5-1c6c-4600-9fc1-687bfe13474c
14:25:33.371 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_17(9fc1687bfe13474cde1c97e51c6c4600).
14:25:33.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.393 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:25:33.397 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID 95249cf1-a357-42b1-9670-69fc4815c606 (pekko://flink/user/rpc/taskmanager_16) at ResourceManager
14:25:33.400 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_17 under registration id 5d01d2bd45c0d06777ef375978ee3b36.
14:25:33.400 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (01c353b3dfaac48d363fa91db2a11301).
14:25:33.400 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor 95249cf1-a357-42b1-9670-69fc4815c606 under 5d01d2bd45c0d06777ef375978ee3b36 at the slot manager.
14:25:33.401 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (01c353b3dfaac48d363fa91db2a11301).
14:25:33.401 [INFO - flink-pekko.actor.default-dispatcher-4] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-01c353b3dfaac48d363fa91db2a11301'.
14:25:33.401 [INFO - mini-cluster-io-thread-2] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 01c353b3dfaac48d363fa91db2a11301 was granted leadership with leader id 63626b97-6512-48e5-aef2-dbb8ce84ed6d. Creating new JobMasterServiceProcess.
14:25:33.406 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_19 .
14:25:33.418 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (01c353b3dfaac48d363fa91db2a11301).
14:25:33.419 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301).
14:25:33.420 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph a199ab64e05ec966270c82784e3241b1 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.420 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301).
14:25:33.420 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:25:33.421 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:25:33.422 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65a3af7e
14:25:33.422 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:33.422 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:25:33.425 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:25:33.425 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@626e94b7 for Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301).
14:25:33.425 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_19 , session=63626b97-6512-48e5-aef2-dbb8ce84ed6d
14:25:33.426 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (01c353b3dfaac48d363fa91db2a11301) under job master id aef2dbb8ce84ed6d63626b97651248e5.
14:25:33.427 [INFO - flink-pekko.actor.default-dispatcher-4] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:33.428 [DEBUG - flink-pekko.actor.default-dispatcher-4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.429 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:25:33.429 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state CREATED to RUNNING.
14:25:33.430 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:25:33.430 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:33.430 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:25:33.431 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:25:33.431 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:25:33.431 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.128.62:37019(127.17.128.62:37019)] Successfully connected to peer
14:25:33.432 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:33.432 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_17(9fc1687bfe13474cde1c97e51c6c4600)
14:25:33.433 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:33.433 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:25:33.434 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.128.61:34199(127.17.128.61:34199)] Successfully connected to peer
14:25:33.434 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:390) Registering job manager aef2dbb8ce84ed6d63626b97651248e5@pekko://flink/user/rpc/jobmanager_19 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.436 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.128.60:42293(127.17.128.60:42293)] Successfully connected to peer
14:25:33.438 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.60
14:25:33.440 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager aef2dbb8ce84ed6d63626b97651248e5@pekko://flink/user/rpc/jobmanager_19 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.442 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 9fc1687bfe13474cde1c97e51c6c4600.
14:25:33.442 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:33.446 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.449 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbaac9186, L:/127.0.0.1:54608 - R:/127.17.128.60:42293] using SASL/PLAIN
14:25:33.452 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.452 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=22), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [21ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: OK, deferred=null) after lookup
14:25:33.455 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:33.455 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:33.455 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:33.456 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.456 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.456 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.456 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.457 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:33.458 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:33.458 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:33.459 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:33.459 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:33.461 [DEBUG - main] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:33.462 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:33.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 839b054b585245fba5afad723631f5a8 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 54b30bbe4a894b06a23047368562c89d for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 242759f5dd6f4ed58bd66f1fb43eab52 for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.463 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:33.463 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:33.466 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.62
14:25:33.466 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.61
14:25:33.473 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 01c353b3dfaac48d363fa91db2a11301
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 95249cf1-a357-42b1-9670-69fc4815c606
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:25:33.474 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.474 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 6295e036bf819b517a25e7bc93bbccc6 from 95249cf1-a357-42b1-9670-69fc4815c606 for job 01c353b3dfaac48d363fa91db2a11301 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.474 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 502ab7224a4d234d987b3014c28d82e3 from 95249cf1-a357-42b1-9670-69fc4815c606 for job 01c353b3dfaac48d363fa91db2a11301 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.474 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 6295e036bf819b517a25e7bc93bbccc6 for job 01c353b3dfaac48d363fa91db2a11301 from resource manager with leader id 9fc1687bfe13474cde1c97e51c6c4600.
14:25:33.475 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 6295e036bf819b517a25e7bc93bbccc6 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.475 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 7e4df4c5072cc4cbd3d010fcf80896db from 95249cf1-a357-42b1-9670-69fc4815c606 for job 01c353b3dfaac48d363fa91db2a11301 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.475 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f637657deada1029ec0e73b52fd27482 from 95249cf1-a357-42b1-9670-69fc4815c606 for job 01c353b3dfaac48d363fa91db2a11301 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.477 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:33.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:33.478211 18936 debug-util.cc:398] Leaking SignalData structure 0x7b0800088820 after lost signal to thread 18866
14:25:33.480 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9c8beef8, L:/127.0.0.1:37340 - R:/127.17.128.61:34199] using SASL/PLAIN
14:25:33.486 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 01c353b3dfaac48d363fa91db2a11301 for job leader monitoring.
14:25:33.486 [INFO - mini-cluster-io-thread-2] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_19 with leader id 63626b97-6512-48e5-aef2-dbb8ce84ed6d.
14:25:33.486 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:33.489 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.490 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 502ab7224a4d234d987b3014c28d82e3 for job 01c353b3dfaac48d363fa91db2a11301 from resource manager with leader id 9fc1687bfe13474cde1c97e51c6c4600.
14:25:33.490 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 502ab7224a4d234d987b3014c28d82e3 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.490 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 7e4df4c5072cc4cbd3d010fcf80896db for job 01c353b3dfaac48d363fa91db2a11301 from resource manager with leader id 9fc1687bfe13474cde1c97e51c6c4600.
14:25:33.491 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 7e4df4c5072cc4cbd3d010fcf80896db with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.491 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request f637657deada1029ec0e73b52fd27482 for job 01c353b3dfaac48d363fa91db2a11301 from resource manager with leader id 9fc1687bfe13474cde1c97e51c6c4600.
14:25:33.491 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for f637657deada1029ec0e73b52fd27482 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:25:33.492 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:25:33.494 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_19 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.494 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.494 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.495 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:25:33.495 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 7e4df4c5072cc4cbd3d010fcf80896db
14:25:33.496 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 7e4df4c5072cc4cbd3d010fcf80896db.
14:25:33.497 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 01c353b3dfaac48d363fa91db2a11301.
14:25:33.497 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:25:33.497 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 01c353b3dfaac48d363fa91db2a11301
14:25:33.498 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 7e4df4c5072cc4cbd3d010fcf80896db.
14:25:33.499 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xed02892f, L:/127.0.0.1:58026 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:33.500 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:25:33.500 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 502ab7224a4d234d987b3014c28d82e3
14:25:33.503 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.504 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.504 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:25:33.504 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id f637657deada1029ec0e73b52fd27482
14:25:33.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:33.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:33.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:33.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:33.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:33.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:33.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:33.507 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:33.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:33.507 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa2200784, L:/127.0.0.1:34876 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:33.508 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:33.508 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:33.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:33.508 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.508 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.508 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.509 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.509 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.509 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.509 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:25:33.508 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:33.509 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 6295e036bf819b517a25e7bc93bbccc6
14:25:33.508 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:33.509 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:33.509 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:33.510 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.510 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.510 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.510 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:33.511 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 502ab7224a4d234d987b3014c28d82e3.
14:25:33.512 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 502ab7224a4d234d987b3014c28d82e3.
14:25:33.513 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7713cec2, L:/127.0.0.1:32806 - R:/127.17.128.62:37019] using SASL/PLAIN
14:25:33.514 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:25:33.514 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:25:33.514 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:33.515 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:33.515 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b31b85c
14:25:33.515 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:33.515 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:33.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:33.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.515 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:25:33.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:33.515 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:25:33.515 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f637657deada1029ec0e73b52fd27482.
14:25:33.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:33.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:33.516 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:25:33.517 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id f637657deada1029ec0e73b52fd27482.
14:25:33.517 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 7e4df4c5072cc4cbd3d010fcf80896db.
14:25:33.517 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 502ab7224a4d234d987b3014c28d82e3.
14:25:33.517 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f637657deada1029ec0e73b52fd27482.
14:25:33.517 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 6295e036bf819b517a25e7bc93bbccc6.
14:25:33.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 6295e036bf819b517a25e7bc93bbccc6.
14:25:33.519 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 6295e036bf819b517a25e7bc93bbccc6.
14:25:33.519 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:25:33.519 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49e4695
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bc15645
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:25:33.520 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:25:33.521 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:25:33.521 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:25:33.523 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:25:33.523 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:25:33.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2a9a7a75
14:25:33.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:33.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:25:33.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:25:33.524 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4094ca77
14:25:33.524 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:25:33.526 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5d2c4383
14:25:33.528 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.528 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55f00ae9
14:25:33.529 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.529 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:33.530 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:33.530 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.531 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@379ee0c0
14:25:33.533 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.534 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:33.534 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:33.534 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:33.536 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:33.537 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:33.540 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:25:33.540 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:33.541 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:33.541 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:33.541 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:33.542 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:33.544 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.545 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:33.545 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:33.548 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:33.548 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:33.551 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.555 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9d75c9da, L:/127.0.0.1:34886 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:33.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.557 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x019f275f, L:/127.0.0.1:58042 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:33.558 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:33.560 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.566 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8d282f22, L:/127.0.0.1:53754 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:33.568 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:33.570 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.570 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=113), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [46ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: OK, [112ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:33.571 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.573 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.575 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.577 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa7e2f5b2, L:/127.0.0.1:58062 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:33.579 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc40c7a50, L:/127.0.0.1:58052 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:33.581 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.581 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.581 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.581 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.582 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.582 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.18.72.252:44649, [7ms] Sub RPC GetTableLocations: received response from server master-127.18.72.252:44649: OK, deferred=null)) after lookup
14:25:33.582 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] connecting to peer
14:25:33.590 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xceb9c592, L:/127.0.0.1:53760 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:33.596 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.596 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=67), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [31ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:33.597 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:33.598 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:33.599 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:33.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.602 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:33.606 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.606 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d47913e
14:25:33.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:25:33.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:25:33.608 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:33.609 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.612 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:25:33.612 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.18.72.254:35143(127.18.72.254:35143)] Successfully connected to peer
14:25:33.615 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.254
14:25:33.616 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf8746736, L:/127.0.0.1:34896 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:33.620 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:33.620 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.623 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:33.625 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:33.626 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.629 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x242773e1, L:/127.0.0.1:53776 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:33.628 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:33.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.634 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5df4f1d1, L:/127.0.0.1:58066 - R:/127.18.72.254:35143] using SASL/PLAIN
14:25:33.634 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.634 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=101), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [40ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [79ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: OK, [94ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:33.638 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.640 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:33.646 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@742a2437
14:25:33.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:25:33.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6dbfe992f7bd8d9bb7ca7e7358bb8728adaffaab3804fc319c3f9b8996d3c1c9'}]
14:25:33.647 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.648 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.651 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.653 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd3818c8c, L:/127.0.0.1:53788 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:33.657 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.657 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=127), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [106ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:33.657 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf797c806, L:/127.0.0.1:34910 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:33.660 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.661 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:25:33.664 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.664 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@25ad38cd
14:25:33.674 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:25:33.679 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299998, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:33.700 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] Successfully connected to peer
14:25:33.705 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:25:33.706 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:25:33.706 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:25:33.713 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:25:33.715 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:25:33.715 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:25:33.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (3/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.718 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d5812a0956c3d94653002f60512fab855ac661d9107c79ef4dce282e68090260'}]
14:25:33.719 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.723 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:25:33.724 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4caac39bd273507f06a250f2feb2556b0433b5a26760c72db3c84318a5c1be4e'}]
14:25:33.725 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:33.730 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.731 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:33.733 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xbd5a450b, L:/127.0.0.1:43512 - R:/127.18.72.193:35669] using TOKEN/null
14:25:33.743 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:25:33.744 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.18.72.252:44649(127.18.72.252:44649)] Successfully connected to peer
14:25:33.749 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.252
14:25:33.752 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:25:33.755 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:25:33.757 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)[L],4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:33.761 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:33.762 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.762 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:33.763 [DEBUG - main] (Connection.java:748) [peer 6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)] connecting to peer
14:25:33.768 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.18.72.253:45261(127.18.72.253:45261)] Successfully connected to peer
14:25:33.772 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.18.72.253
14:25:33.778 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:25:33.778 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.779 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:33.782 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.793 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:33.799 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd3562376, L:/127.0.0.1:53802 - R:/127.18.72.252:44649] using SASL/PLAIN
14:25:33.800 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.802 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:25:33.803 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=272), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [52ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: OK, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [266ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: OK, deferred=null) after lookup
14:25:33.803 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd909737e, L:/127.0.0.1:34916 - R:/127.18.72.253:45261] using SASL/PLAIN
14:25:33.805 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.806 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x78c15973, L:/127.0.0.1:59884 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:33.807 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:33.811 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:33.811 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@34ab9ce8
14:25:33.813 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:25:33.813 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:25:33.819 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)] Successfully connected to peer
14:25:33.826 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:33.845 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.848 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x1727f287, L:/127.0.0.1:33330 - R:/127.18.72.195:46487] using TOKEN/null
14:25:33.849 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:33.867 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:33.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.873 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.873 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:33.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:33.883 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.887 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe5762705, L:/127.0.0.1:59896 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:33.888 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.909 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252309725184001) for scanner KuduScanner(table=replication_test_table, tablet=54b30bbe4a894b06a23047368562c89d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.910 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [d5812a0956c3d94653002f60512fab855ac661d9107c79ef4dce282e68090260]
14:25:33.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d5812a0956c3d94653002f60512fab855ac661d9107c79ef4dce282e68090260]
14:25:33.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:25:33.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:25:33.915 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:33.915 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d5812a0956c3d94653002f60512fab855ac661d9107c79ef4dce282e68090260 finished by subtask 0; deferring removal (restored in pending)
14:25:33.915 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:33.921 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:25:33.921 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:25:33.926 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false, responseScanTimestamp = 7287252309725184001) for scanner KuduScanner(table=replication_test_table, tablet=839b054b585245fba5afad723631f5a8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.927 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6dbfe992f7bd8d9bb7ca7e7358bb8728adaffaab3804fc319c3f9b8996d3c1c9]
14:25:33.927 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:25:33.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.934 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.936 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6dbfe992f7bd8d9bb7ca7e7358bb8728adaffaab3804fc319c3f9b8996d3c1c9]
14:25:33.936 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6dbfe992f7bd8d9bb7ca7e7358bb8728adaffaab3804fc319c3f9b8996d3c1c9 finished by subtask 1; deferring removal (restored in pending)
14:25:33.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.940 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.941 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.941 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.941 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.941 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.942 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:25:33.942 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:25:33.943 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:33.943 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:33.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:33.949 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.949 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.950 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for table 'replication_test_table' with partition [<start>, 0x80000064)
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ea0fcf1a22234f0db9e31bb193bfcb0e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
14:25:33.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet edaa4198067a4dda9f9f12abacccee3a for table 'replication_test_table' with partition [0x800000C8, <end>)
14:25:33.950 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669),4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4198067a4dda9f9f12abacccee3a@[3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)[L],4d16dcc0d1ea41e1b3b0ed5ecc272af2(127.18.72.194:41419),6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)]}]
14:25:33.956 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:33.960 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:33.969 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:33.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:33.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:33.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:33.977 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.977 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.977 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:33.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.977 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:33.977 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.978 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.978 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:33.978 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:33.985 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:33.992 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x50d2a6af, L:/127.0.0.1:59908 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:34.009 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252309725184001) for scanner KuduScanner(table=replication_test_table, tablet=242759f5dd6f4ed58bd66f1fb43eab52, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.009 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [4caac39bd273507f06a250f2feb2556b0433b5a26760c72db3c84318a5c1be4e]
14:25:34.009 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4caac39bd273507f06a250f2feb2556b0433b5a26760c72db3c84318a5c1be4e]
14:25:34.009 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:25:34.009 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:25:34.010 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:34.011 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4caac39bd273507f06a250f2feb2556b0433b5a26760c72db3c84318a5c1be4e finished by subtask 2; deferring removal (restored in pending)
14:25:34.012 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.012 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.027 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.027 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.036 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.037 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:34.056 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:34.056 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:34.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.056 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:25:34.056 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:25:34.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:34.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:34.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:34.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:34.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:34.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:34.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:34.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:34.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:34.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:34.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:34.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:34.080 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:34.085 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:34.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:34.085 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:25:34.086 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:25:34.087 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:34.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:34.088 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:25:34.088 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:25:34.095 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.095 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.103 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.103 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.110 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.166 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.166 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.172 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.172 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.177 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.179 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:34.179 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:34.179 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:34.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.180 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.180 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.180 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.180 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:34.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114334185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:34.189 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=15, operationSize=950, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7ebfccaa, flushNotification=Deferred@1289687284(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:25:34.192 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] connecting to peer
14:25:34.232 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.233 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.245 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.245 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.248 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:34.248 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:34.248 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:34.249 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:34.249 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:34.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:34.249 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:34.250 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:34.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:34.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:34.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:34.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:34.250 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:34.252 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.260 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] Successfully connected to peer
14:25:34.290 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:34.292 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x6cbaf4e7, L:/127.0.0.1:43524 - R:/127.18.72.193:35669] using TOKEN/null
14:25:34.309 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.310 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.316 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.316 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.376 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.377 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.377 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.384 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:34.384 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:34.384 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:34.384 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:34.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:34.385 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:34.385 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:34.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:34.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:34.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:34.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:34.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:34.385 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:34.387 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.387 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.392 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.407 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:34.408 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:34.408 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:34.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.409 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:34.451 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.451 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.459 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.459 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.465 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.478 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 01c353b3dfaac48d363fa91db2a11301 (2859 bytes, checkpointDuration=293 ms, finalizationTime=0 ms).
14:25:34.480 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:25:34.480 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split d5812a0956c3d94653002f60512fab855ac661d9107c79ef4dce282e68090260 from pending
14:25:34.480 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 6dbfe992f7bd8d9bb7ca7e7358bb8728adaffaab3804fc319c3f9b8996d3c1c9 from pending
14:25:34.480 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 4caac39bd273507f06a250f2feb2556b0433b5a26760c72db3c84318a5c1be4e from pending
14:25:34.480 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 3 finished splits from enumerator state
14:25:34.482 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:34.482 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:34.482 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:34.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:34.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:34.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:34.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:34.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:34.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:34.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:34.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:34.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:34.484 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:34.527 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.527 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.533 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.533 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.545 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.548 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:34.554 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:34.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.557 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:34.560 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:34.563 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:34.566 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 48ceed0eecfd45e9a649a4a94ba8809b
14:25:34.592 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=839b054b585245fba5afad723631f5a8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.592 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 839b054b585245fba5afad723631f5a8 for partition [<start>, 0x80000064) with scanner id null
14:25:34.600 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=54b30bbe4a894b06a23047368562c89d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.600 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 54b30bbe4a894b06a23047368562c89d for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.600 [DEBUG - main] (Connection.java:748) [peer c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)] connecting to peer
14:25:34.609 [DEBUG - kudu-nio-4] (Connection.java:757) [peer c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)] Successfully connected to peer
14:25:34.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.644 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:34.647 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xc9e3fadb, L:/127.0.0.1:47582 - R:/127.17.128.2:44563] using TOKEN/null
14:25:34.681 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=242759f5dd6f4ed58bd66f1fb43eab52, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114334685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:34.695 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.695 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.697 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:34.698 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:25:34.704 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.704 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.711 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=839b054b585245fba5afad723631f5a8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 839b054b585245fba5afad723631f5a8 for partition [<start>, 0x80000064) with scanner id null
14:25:34.728 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:34.728 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:34.728 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:34.729 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.729 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.729 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:34.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:34.734 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.734 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.734 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:34.734 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:34.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=54b30bbe4a894b06a23047368562c89d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 54b30bbe4a894b06a23047368562c89d for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.745 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=242759f5dd6f4ed58bd66f1fb43eab52, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc0006cb8cdb4c57bb0c72e7ae0c41e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet dc0006cb8cdb4c57bb0c72e7ae0c41e4 for partition [<start>, 0x80000064) with scanner id null
14:25:34.764 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea0fcf1a22234f0db9e31bb193bfcb0e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.764 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea0fcf1a22234f0db9e31bb193bfcb0e for partition [0x80000064, 0x800000C8) with scanner id null
14:25:34.779 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4198067a4dda9f9f12abacccee3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:34.780 [DEBUG - main] (Connection.java:575) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] disconnecting while in state READY
14:25:34.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state READY
14:25:34.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state READY
14:25:34.780 [DEBUG - main] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state READY
14:25:34.780 [DEBUG - main] (Connection.java:575) [peer 6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)] disconnecting while in state READY
14:25:34.781 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:34.781 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:34.781 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:34.782 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:34.782 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:34.782 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:34.782 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)] handling channelInactive
14:25:34.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 6420fff486b542d4af7311f720e1b3b3(127.18.72.195:46487)] cleaning up while in state READY due to: connection closed
14:25:34.783 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:34.785 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:25:34.785 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
14:25:34.785 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
14:25:34.786 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:25:34.798 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] handling channelInactive
14:25:34.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] cleaning up while in state READY due to: connection closed
14:25:34.798 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
14:25:34.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:34.798516 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 19084
14:25:34.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:34.933 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] handling channelInactive
14:25:34.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] cleaning up while in state READY due to: connection closed
14:25:34.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:34.936324 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 19243
14:25:34.976 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:34.976 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:34.976 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:34.977 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.977 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.977 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:34.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.978 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:34.978 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.978 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.978 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:34.978 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:34.996107 19465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.72.193:35669: connect: Connection refused (error 111)
14:25:35.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:35.003151 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 19444
14:25:35.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.086 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:35.087 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:35.087 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:35.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.089 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.089 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:35.103 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:35.103 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:35.103 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:35.103 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.103 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.103 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.103 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.103 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.103 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.104 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:35.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:35.135965 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18788
14:25:35.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114335185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:35.199 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:25:35.200 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:25:35.215 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:35.215 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:35.215 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:35.216 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.216 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:35.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:35.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:35.217 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:35.226 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:35.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:35.226 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:35.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:35.227 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:35.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:35.227 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.18.72.254:35143(127.18.72.254:35143)] handling channelInactive
14:25:35.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state READY due to: connection closed
14:25:35.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:35.243507 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18862
14:25:35.274 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:35.274 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:35.274 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:35.275 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:35.275 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:35.275 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:35.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:35.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:35.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:35.276 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:35.276 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:35.276 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:35.276 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:35.286 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:35.286 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:35.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:35.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:35.287 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:35.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:35.287 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.18.72.253:45261(127.18.72.253:45261)] handling channelInactive
14:25:35.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state READY due to: connection closed
14:25:35.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:35.298919 18723 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18942
14:25:35.339 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:35.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.18.72.252:44649(127.18.72.252:44649)] handling channelInactive
14:25:35.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state READY due to: connection closed
14:25:35.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.433 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:35.437 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f359d1ffbd5cdc9f1158c9f43fd5103e091c14103b0e91be5dea3461bfc2ef3c'}]
14:25:35.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4599fa4169b6baab5d5b263d7ef596b0d8db1352e747d8910cdb6e955c35d324'}]
14:25:35.439 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:35.439 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:25:35.439 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1bd84519972570e8788bd9f568c36cf9f0ed9866c8bee1e8ca6289c1540ce33c'}]
14:25:35.440 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=298027, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)[L],4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:35.441 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:35.441 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:25:35.444 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=298027, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:35.445 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:35.478 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:35.487 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:35.500 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:25:35.500 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=298027, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:35.508 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:35.514 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:35.523 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:35.524 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:35.535 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:35.538 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:35.553 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:35.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.560 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:35.560 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:35.562 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6c335101, L:/127.0.0.1:59924 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:35.562 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6d760c24, L:/127.0.0.1:59914 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:35.566 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:35.569 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc3be18f1, L:/127.0.0.1:59938 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:35.581 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252317917184001) for scanner KuduScanner(table=replication_test_table, tablet=839b054b585245fba5afad723631f5a8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:35.581 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [f359d1ffbd5cdc9f1158c9f43fd5103e091c14103b0e91be5dea3461bfc2ef3c]
14:25:35.581 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f359d1ffbd5cdc9f1158c9f43fd5103e091c14103b0e91be5dea3461bfc2ef3c]
14:25:35.582 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:25:35.582 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:25:35.582 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f359d1ffbd5cdc9f1158c9f43fd5103e091c14103b0e91be5dea3461bfc2ef3c finished by subtask 3; deferring removal (restored in pending)
14:25:35.583 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:35.584 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:35.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.628 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:35.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:35.628 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:35.629 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:25:35.629 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:35.628 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:25:35.629 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:35.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:35.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.630 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:35.630 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.630 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.630 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:35.630 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:35.688 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114335685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:35.754 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252317917184001) for scanner KuduScanner(table=replication_test_table, tablet=242759f5dd6f4ed58bd66f1fb43eab52, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:35.755 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [1bd84519972570e8788bd9f568c36cf9f0ed9866c8bee1e8ca6289c1540ce33c]
14:25:35.756 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1bd84519972570e8788bd9f568c36cf9f0ed9866c8bee1e8ca6289c1540ce33c]
14:25:35.757 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:25:35.757 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:25:35.758 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1bd84519972570e8788bd9f568c36cf9f0ed9866c8bee1e8ca6289c1540ce33c finished by subtask 1; deferring removal (restored in pending)
14:25:35.760 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:35.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:35.763 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 01c353b3dfaac48d363fa91db2a11301 (2889 bytes, checkpointDuration=78 ms, finalizationTime=0 ms).
14:25:35.765 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:25:35.765 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 1bd84519972570e8788bd9f568c36cf9f0ed9866c8bee1e8ca6289c1540ce33c from pending
14:25:35.765 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split f359d1ffbd5cdc9f1158c9f43fd5103e091c14103b0e91be5dea3461bfc2ef3c from pending
14:25:35.765 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 2 finished splits from enumerator state
14:25:35.773 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252317917184001) for scanner KuduScanner(table=replication_test_table, tablet=54b30bbe4a894b06a23047368562c89d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:35.773 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [4599fa4169b6baab5d5b263d7ef596b0d8db1352e747d8910cdb6e955c35d324]
14:25:35.774 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4599fa4169b6baab5d5b263d7ef596b0d8db1352e747d8910cdb6e955c35d324]
14:25:35.774 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:25:35.774 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:25:35.774 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4599fa4169b6baab5d5b263d7ef596b0d8db1352e747d8910cdb6e955c35d324 finished by subtask 0; deferring removal (restored in pending)
14:25:35.775 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:35.775 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:35.795 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:35.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:35.796 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:25:35.796 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:25:35.822 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:35.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:35.822 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:25:35.822 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:25:35.863 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:35.863 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:35.863 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:35.864 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:35.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:35.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:35.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:35.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:35.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:35.865 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:35.865 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:35.865 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:35.865 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:35.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:35.876 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.117 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:36.117 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:36.117 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:36.118 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.118 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.118 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.119 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:36.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114336186 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:36.200 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 01c353b3dfaac48d363fa91db2a11301 (1611 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:25:36.202 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:25:36.202 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 4599fa4169b6baab5d5b263d7ef596b0d8db1352e747d8910cdb6e955c35d324 from pending
14:25:36.202 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
14:25:36.326 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:36.327 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:36.327 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:36.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.327 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.327 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.328 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.328 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.328 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.328 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:36.335 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:36.335 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:36.335 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:36.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.336 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.337 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.337 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.337 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.337 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:36.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.373 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:36.373 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:36.374 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:36.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:36.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:36.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:36.375 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:36.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.414 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:36.414 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:36.414 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:36.414 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.415 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:36.428 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:36.428 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:36.428 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:36.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.429 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.429 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.429 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.430 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.430 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:36.430 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [38ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [43ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [44ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [74ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [245ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [246ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [482ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1403ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2340ms] refreshing cache from master, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2342ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [5000ms] refreshing cache from master, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@1075509804(state=PENDING, result=null, callback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826), errback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826)))
14:25:36.431 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:25:36.432 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [38ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [43ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [44ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [74ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [245ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [246ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [482ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1403ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2340ms] refreshing cache from master, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2342ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [5000ms] refreshing cache from master, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@1075509804(state=PENDING, result=null, callback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826), errback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:36.432 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:25:36.434 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:25:36.437 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [38ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [43ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [44ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [74ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [78ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [78ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [243ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [245ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [246ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [482ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1403ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2340ms] refreshing cache from master, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2342ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [5000ms] refreshing cache from master, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@1075509804(state=PENDING, result=null, callback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826), errback=(continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928) -> (continuation of Deferred@2032633888 after retry RPC after error@487163542) -> (continuation of Deferred@831298155 after retry RPC after error@1051951174) -> (continuation of Deferred@2073061688 after retry RPC after error@721186282) -> (continuation of Deferred@2146891036 after retry RPC after error@1575353108) -> (continuation of Deferred@633638969 after retry RPC after error@1822308950) -> (continuation of Deferred@604531916 after retry RPC after error@1455885826)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:36.440 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:36.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
14:25:36.442 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:25:36.442 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:25:36.547 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:36.548 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:36.548 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:36.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:36.548 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.548 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:36.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:36.549 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:36.588 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.588 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.588 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.589 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.589 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.589 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.589 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.589 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.589 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.589 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.590 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.590 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.590 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.590 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29304), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [53ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [108ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [114ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [124ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [2583ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@893998064(state=PENDING, result=null, callback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249), errback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249)))
14:25:36.591 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.591 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.591 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.592 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29304), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [53ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [108ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [114ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [124ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [2583ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@893998064(state=PENDING, result=null, callback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249), errback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29304), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [53ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [108ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [114ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [124ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [2583ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@893998064(state=PENDING, result=null, callback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249), errback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:36.593 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.593 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.593 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.596 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29304), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [53ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [108ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [114ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [124ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [2583ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@893998064(state=PENDING, result=null, callback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249), errback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29304), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [53ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [108ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [114ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [124ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [2583ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [3121ms] too many traces: truncated at 100 traces, deferred=Deferred@893998064(state=PENDING, result=null, callback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249), errback=(continuation of Deferred@2041784093 after retry RPC after error@1466611806) -> (continuation of Deferred@347371797 after retry RPC after error@1797095072) -> (continuation of Deferred@200685329 after retry RPC after error@165467769) -> (continuation of Deferred@1041721990 after retry RPC after error@1048574874) -> (continuation of Deferred@76226043 after retry RPC after error@1804299277) -> (continuation of Deferred@1850570912 after retry RPC after error@800058840) -> (continuation of Deferred@1939298579 after retry RPC after error@1129097320) -> (continuation of Deferred@1178681561 after retry RPC after error@374383844) -> (continuation of Deferred@1598433532 after retry RPC after error@2045760660) -> (continuation of Deferred@904140024 after retry RPC after error@645980452) -> (continuation of Deferred@1215245504 after retry RPC after error@1327696429) -> (continuation of Deferred@1517651173 after retry RPC after error@2078136142) -> (continuation of Deferred@1248194009 after retry RPC after error@499184858) -> (continuation of Deferred@1810110763 after retry RPC after error@2123809982) -> (continuation of Deferred@469300624 after retry RPC after error@17081361) -> (continuation of Deferred@1256376411 after retry RPC after error@35214989) -> (continuation of Deferred@1578198827 after retry RPC after error@2047964372) -> (continuation of Deferred@644733917 after retry RPC after error@1854426275) -> (continuation of Deferred@1005934182 after retry RPC after error@1244869144) -> (continuation of Deferred@46709680 after retry RPC after error@772342302) -> (continuation of Deferred@1071523807 after retry RPC after error@1823367630) -> (continuation of Deferred@737952464 after retry RPC after error@1300474947) -> (continuation of Deferred@53320435 after retry RPC after error@479341385) -> (continuation of Deferred@1437663433 after retry RPC after error@83906440) -> (continuation of Deferred@1788192729 after retry RPC after error@1741689249)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:36.597 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:36.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
14:25:36.598 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
14:25:36.598 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:25:36.598 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
14:25:36.598 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:25:36.598 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
14:25:36.599 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:25:36.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:36.599 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
14:25:36.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:36.599 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
14:25:36.599 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:36.599 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.599 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.599 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.600 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.600 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.600 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.602 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:36.608 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.608 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.608 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.609 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.609 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.609 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.609 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.609 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.611 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:25:36.612 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
14:25:36.612 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:25:36.618 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:36.619 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
14:25:36.619 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:36.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:25:36.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:25:36.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:25:36.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.628 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.628 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.628 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.630 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.633 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:25:36.633 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
14:25:36.633 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:25:36.638 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:25:36.638 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
14:25:36.638 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:25:36.647 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:25:36.648 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
14:25:36.648 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.648 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.648 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:25:36.648 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.648 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
14:25:36.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.649 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:36.649 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
14:25:36.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.651 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.651 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:36.652 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
14:25:36.652 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 77d052e6e51b5ae35525074f80512696
14:25:36.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.668 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.670 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.670 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:36.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:36.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:36.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.680 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.680 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.680 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.680 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.680 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:36.689 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114336686 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:36.696 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:36.696 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:36.696 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:36.697 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.697 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:36.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.698 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:36.698 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:25:36.708 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.708 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.708 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.708 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.708 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.709 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.709 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.709 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.709 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.727 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.727 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.728 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.728 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.728 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.728 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.728 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.728 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.728 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.728 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:36.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:36.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:36.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:36.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.827 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.827 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:36.828 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.828 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.828 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:36.828 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:36.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.829 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.829 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.829 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.828 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.829 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.847 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:36.847 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:36.848 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:36.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:36.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:36.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:36.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:36.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:36.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:36.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:36.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:36.921 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.921 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:36.921 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.921 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.921 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:36.921 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:36.922 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:36.942 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:36.942 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:36.942 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:36.942 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:36.942 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:36.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:36.943 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:36.943 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:36.943 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:36.943 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:36.943 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:36.943 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:36.943 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:37.008 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:37.008 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:37.008 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:37.009 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.009 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.009 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.010 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:37.010 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29744), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [7ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [39ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [43ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [73ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [77ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [124ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [125ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [125ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [323ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [643ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [643ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [763ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [764ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [764ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [764ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2642ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3461ms] refreshing cache from master, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@908711875(state=PENDING, result=null, callback=(continuation of Deferred@413086977 after retry RPC after error@1995546422) -> (continuation of Deferred@138823574 after retry RPC after error@1890127506) -> (continuation of Deferred@301931195 after retry RPC after error@1796026269) -> (continuation of Deferred@1372434333 after retry RPC after error@1772680872) -> (continuation of Deferred@15406052 after retry RPC after error@43558307) -> (continuation of Deferred@1049973546 after retry RPC after error@279375846) -> (continuation of Deferred@1217051173 after retry RPC after error@267954986) -> (continuation of Deferred@467707388 after retry RPC after error@1017028793) -> (continuation of Deferred@559447709 after retry RPC after error@1798512743) -> (continuation of Deferred@1977792440 after retry RPC after error@1009801941) -> (continuation of Deferred@1585346392 after retry RPC after error@742151400) -> (continuation of Deferred@1283684768 after retry RPC after error@1918596119) -> (continuation of Deferred@1597118899 after retry RPC after error@292003241) -> (continuation of Deferred@1191098460 after retry RPC after error@1865189208) -> (continuation of Deferred@538768527 after retry RPC after error@222019568) -> (continuation of Deferred@1052039763 after retry RPC after error@900308122) -> (continuation of Deferred@1918287404 after retry RPC after error@574774185) -> (continuation of Deferred@977042416 after retry RPC after error@1133018465) -> (continuation of Deferred@73932002 after retry RPC after error@885489877) -> (continuation of Deferred@1845333574 after retry RPC after error@1830721005) -> (continuation of Deferred@693439392 after retry RPC after error@555542391) -> (continuation of Deferred@538100396 after retry RPC after error@968526526) -> (continuation of Deferred@942902818 after retry RPC after error@2119360780) -> (continuation of Deferred@1222859720 after retry RPC after error@635553552), errback=(continuation of Deferred@413086977 after retry RPC after error@1995546422) -> (continuation of Deferred@138823574 after retry RPC after error@1890127506) -> (continuation of Deferred@301931195 after retry RPC after error@1796026269) -> (continuation of Deferred@1372434333 after retry RPC after error@1772680872) -> (continuation of Deferred@15406052 after retry RPC after error@43558307) -> (continuation of Deferred@1049973546 after retry RPC after error@279375846) -> (continuation of Deferred@1217051173 after retry RPC after error@267954986) -> (continuation of Deferred@467707388 after retry RPC after error@1017028793) -> (continuation of Deferred@559447709 after retry RPC after error@1798512743) -> (continuation of Deferred@1977792440 after retry RPC after error@1009801941) -> (continuation of Deferred@1585346392 after retry RPC after error@742151400) -> (continuation of Deferred@1283684768 after retry RPC after error@1918596119) -> (continuation of Deferred@1597118899 after retry RPC after error@292003241) -> (continuation of Deferred@1191098460 after retry RPC after error@1865189208) -> (continuation of Deferred@538768527 after retry RPC after error@222019568) -> (continuation of Deferred@1052039763 after retry RPC after error@900308122) -> (continuation of Deferred@1918287404 after retry RPC after error@574774185) -> (continuation of Deferred@977042416 after retry RPC after error@1133018465) -> (continuation of Deferred@73932002 after retry RPC after error@885489877) -> (continuation of Deferred@1845333574 after retry RPC after error@1830721005) -> (continuation of Deferred@693439392 after retry RPC after error@555542391) -> (continuation of Deferred@538100396 after retry RPC after error@968526526) -> (continuation of Deferred@942902818 after retry RPC after error@2119360780) -> (continuation of Deferred@1222859720 after retry RPC after error@635553552)))
14:25:37.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:37.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:37.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:37.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.148 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.148 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.148 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:37.148 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29892), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [4ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [26ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [29ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [51ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [53ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [53ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [53ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [123ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [123ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [163ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [163ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [323ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [763ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [763ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [764ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [764ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [941ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [942ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [942ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [942ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3000ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3001ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [3001ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3013ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3013ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [5180ms] refreshing cache from master, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [5181ms] too many traces: truncated at 100 traces, deferred=Deferred@1581548997(state=PENDING, result=null, callback=(continuation of Deferred@1884620014 after retry RPC after error@1904019515) -> (continuation of Deferred@1068844954 after retry RPC after error@1160091396) -> (continuation of Deferred@495950138 after retry RPC after error@78276192) -> (continuation of Deferred@288778488 after retry RPC after error@2026000493) -> (continuation of Deferred@426065926 after retry RPC after error@1311489068) -> (continuation of Deferred@1819835577 after retry RPC after error@114497635) -> (continuation of Deferred@897912271 after retry RPC after error@651959695) -> (continuation of Deferred@158212185 after retry RPC after error@400564503) -> (continuation of Deferred@169262417 after retry RPC after error@1281419769) -> (continuation of Deferred@888431812 after retry RPC after error@571081684) -> (continuation of Deferred@491380465 after retry RPC after error@1445843840) -> (continuation of Deferred@1105743813 after retry RPC after error@856617103) -> (continuation of Deferred@1625493065 after retry RPC after error@1483370502) -> (continuation of Deferred@1543477929 after retry RPC after error@531727313) -> (continuation of Deferred@1742231336 after retry RPC after error@1824121237) -> (continuation of Deferred@1270092921 after retry RPC after error@1485355477) -> (continuation of Deferred@2110575867 after retry RPC after error@1591359390) -> (continuation of Deferred@891746272 after retry RPC after error@687715968) -> (continuation of Deferred@856544360 after retry RPC after error@1021600592) -> (continuation of Deferred@1056901851 after retry RPC after error@2071192114) -> (continuation of Deferred@637589408 after retry RPC after error@971103955) -> (continuation of Deferred@2131669734 after retry RPC after error@461946183) -> (continuation of Deferred@999674945 after retry RPC after error@204837542) -> (continuation of Deferred@103188548 after retry RPC after error@1478131522) -> (continuation of Deferred@1295552476 after retry RPC after error@1832424575), errback=(continuation of Deferred@1884620014 after retry RPC after error@1904019515) -> (continuation of Deferred@1068844954 after retry RPC after error@1160091396) -> (continuation of Deferred@495950138 after retry RPC after error@78276192) -> (continuation of Deferred@288778488 after retry RPC after error@2026000493) -> (continuation of Deferred@426065926 after retry RPC after error@1311489068) -> (continuation of Deferred@1819835577 after retry RPC after error@114497635) -> (continuation of Deferred@897912271 after retry RPC after error@651959695) -> (continuation of Deferred@158212185 after retry RPC after error@400564503) -> (continuation of Deferred@169262417 after retry RPC after error@1281419769) -> (continuation of Deferred@888431812 after retry RPC after error@571081684) -> (continuation of Deferred@491380465 after retry RPC after error@1445843840) -> (continuation of Deferred@1105743813 after retry RPC after error@856617103) -> (continuation of Deferred@1625493065 after retry RPC after error@1483370502) -> (continuation of Deferred@1543477929 after retry RPC after error@531727313) -> (continuation of Deferred@1742231336 after retry RPC after error@1824121237) -> (continuation of Deferred@1270092921 after retry RPC after error@1485355477) -> (continuation of Deferred@2110575867 after retry RPC after error@1591359390) -> (continuation of Deferred@891746272 after retry RPC after error@687715968) -> (continuation of Deferred@856544360 after retry RPC after error@1021600592) -> (continuation of Deferred@1056901851 after retry RPC after error@2071192114) -> (continuation of Deferred@637589408 after retry RPC after error@971103955) -> (continuation of Deferred@2131669734 after retry RPC after error@461946183) -> (continuation of Deferred@999674945 after retry RPC after error@204837542) -> (continuation of Deferred@103188548 after retry RPC after error@1478131522) -> (continuation of Deferred@1295552476 after retry RPC after error@1832424575)))
14:25:37.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:37.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:37.168 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:37.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.169 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:37.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114337185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:37.195 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:25:37.196 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:37.196 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:37.196 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:37.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:37.197 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.197 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.197 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:37.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:25:37.198 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.198 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.198 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:37.198 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:37.199 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29975), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [23ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [242ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [242ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [242ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [704ms] refreshing cache from master, [704ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [704ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [704ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [705ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [705ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [705ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [705ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1220ms] refreshing cache from master, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1222ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1403ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1982ms] refreshing cache from master, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1984ms] too many traces: truncated at 100 traces, deferred=Deferred@765064618(state=PENDING, result=null, callback=(continuation of Deferred@787581919 after retry RPC after error@1962631978) -> (continuation of Deferred@173591965 after retry RPC after error@1745771993) -> (continuation of Deferred@1241746548 after retry RPC after error@1708016685) -> (continuation of Deferred@691423532 after retry RPC after error@869022022) -> (continuation of Deferred@1702523751 after retry RPC after error@1912777929) -> (continuation of Deferred@1776743564 after retry RPC after error@1001580287) -> (continuation of Deferred@224746405 after retry RPC after error@1785121316) -> (continuation of Deferred@888799600 after retry RPC after error@408132622) -> (continuation of Deferred@1061967058 after retry RPC after error@1671929589) -> (continuation of Deferred@129163888 after retry RPC after error@59092324) -> (continuation of Deferred@1588757250 after retry RPC after error@29228567) -> (continuation of Deferred@286010674 after retry RPC after error@1070357754) -> (continuation of Deferred@1965847186 after retry RPC after error@453994342) -> (continuation of Deferred@1805298824 after retry RPC after error@913049229) -> (continuation of Deferred@541215280 after retry RPC after error@1083583753) -> (continuation of Deferred@2127964031 after retry RPC after error@676863558) -> (continuation of Deferred@444191415 after retry RPC after error@1811307156) -> (continuation of Deferred@617903434 after retry RPC after error@1276573112) -> (continuation of Deferred@414087911 after retry RPC after error@1104519580) -> (continuation of Deferred@1177350857 after retry RPC after error@1030513793) -> (continuation of Deferred@1451120777 after retry RPC after error@978045595) -> (continuation of Deferred@458284449 after retry RPC after error@1162279462) -> (continuation of Deferred@1633179671 after retry RPC after error@94587317) -> (continuation of Deferred@411246965 after retry RPC after error@1785098121) -> (continuation of Deferred@1239222834 after retry RPC after error@1445731421), errback=(continuation of Deferred@787581919 after retry RPC after error@1962631978) -> (continuation of Deferred@173591965 after retry RPC after error@1745771993) -> (continuation of Deferred@1241746548 after retry RPC after error@1708016685) -> (continuation of Deferred@691423532 after retry RPC after error@869022022) -> (continuation of Deferred@1702523751 after retry RPC after error@1912777929) -> (continuation of Deferred@1776743564 after retry RPC after error@1001580287) -> (continuation of Deferred@224746405 after retry RPC after error@1785121316) -> (continuation of Deferred@888799600 after retry RPC after error@408132622) -> (continuation of Deferred@1061967058 after retry RPC after error@1671929589) -> (continuation of Deferred@129163888 after retry RPC after error@59092324) -> (continuation of Deferred@1588757250 after retry RPC after error@29228567) -> (continuation of Deferred@286010674 after retry RPC after error@1070357754) -> (continuation of Deferred@1965847186 after retry RPC after error@453994342) -> (continuation of Deferred@1805298824 after retry RPC after error@913049229) -> (continuation of Deferred@541215280 after retry RPC after error@1083583753) -> (continuation of Deferred@2127964031 after retry RPC after error@676863558) -> (continuation of Deferred@444191415 after retry RPC after error@1811307156) -> (continuation of Deferred@617903434 after retry RPC after error@1276573112) -> (continuation of Deferred@414087911 after retry RPC after error@1104519580) -> (continuation of Deferred@1177350857 after retry RPC after error@1030513793) -> (continuation of Deferred@1451120777 after retry RPC after error@978045595) -> (continuation of Deferred@458284449 after retry RPC after error@1162279462) -> (continuation of Deferred@1633179671 after retry RPC after error@94587317) -> (continuation of Deferred@411246965 after retry RPC after error@1785098121) -> (continuation of Deferred@1239222834 after retry RPC after error@1445731421)))
14:25:37.258 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:37.259 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:37.259 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:37.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.260 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:37.303 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:37.303 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:37.303 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:37.304 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:37.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:37.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:37.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:37.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:37.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:37.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:37.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:37.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:37.305 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:37.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.377 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:37.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:37.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:37.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:37.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:37.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:37.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:37.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:37.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:37.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:37.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:37.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:37.425 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:37.433 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bcb23d64ff464dda9c329f206be68c10
14:25:37.436 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0c4a60771d524aa0578e2de69586340c60f69d98f414cd4d6d01412fe01cea7b'}]
14:25:37.437 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:37.437 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:25:37.438 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2ec2e84552394867a7cec0af624e9fca05e783c0b92ae320fbcef45b882175a0'}]
14:25:37.438 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=296028, tablet=839b054b585245fba5afad723631f5a8@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)[L]]}]
14:25:37.439 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:37.439 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:25:37.439 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='08ae4aa2916f0e82976ee49c6af85792072ed1354c294b1fa0dc957d8eeb7c3e'}]
14:25:37.440 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=296028, tablet=54b30bbe4a894b06a23047368562c89d@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)[L],4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201),c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:37.440 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:37.441 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:25:37.441 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=296028, tablet=242759f5dd6f4ed58bd66f1fb43eab52@[4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479),4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)[L],c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)]}]
14:25:37.443 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:37.448 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:37.475 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:37.476 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:37.477 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] connecting to peer
14:25:37.478 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] Successfully connected to peer
14:25:37.501 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:37.513 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:37.514 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:37.516 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.128.3
14:25:37.519 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x36cf5d9a, L:/127.0.0.1:59950 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:37.528 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:37.529 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:25:37.531 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x734b9ad4, L:/127.0.0.1:59970 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:37.535 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa50e5e65, L:/127.0.0.1:59964 - R:/127.17.128.3:42479] using SASL/PLAIN
14:25:37.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:37.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:37.548 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:37.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:37.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:37.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:37.550 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:37.624 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252326109184001) for scanner KuduScanner(table=replication_test_table, tablet=242759f5dd6f4ed58bd66f1fb43eab52, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:37.625 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [08ae4aa2916f0e82976ee49c6af85792072ed1354c294b1fa0dc957d8eeb7c3e]
14:25:37.625 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [08ae4aa2916f0e82976ee49c6af85792072ed1354c294b1fa0dc957d8eeb7c3e]
14:25:37.625 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:25:37.625 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:25:37.626 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 08ae4aa2916f0e82976ee49c6af85792072ed1354c294b1fa0dc957d8eeb7c3e finished by subtask 1; deferring removal (restored in pending)
14:25:37.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.646 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:37.647 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:37.684 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:37.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:37.684 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:25:37.684 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:25:37.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114337685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:37.700 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 01c353b3dfaac48d363fa91db2a11301 (2889 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
14:25:37.702 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:25:37.702 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 08ae4aa2916f0e82976ee49c6af85792072ed1354c294b1fa0dc957d8eeb7c3e from pending
14:25:37.702 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 1 finished splits from enumerator state
14:25:37.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:37Z chronyd exiting
14:25:37.819 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252326109184001) for scanner KuduScanner(table=replication_test_table, tablet=54b30bbe4a894b06a23047368562c89d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:37.819 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [2ec2e84552394867a7cec0af624e9fca05e783c0b92ae320fbcef45b882175a0]
14:25:37.823 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2ec2e84552394867a7cec0af624e9fca05e783c0b92ae320fbcef45b882175a0]
14:25:37.823 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:25:37.823 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:25:37.824 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2ec2e84552394867a7cec0af624e9fca05e783c0b92ae320fbcef45b882175a0 finished by subtask 3; deferring removal (restored in pending)
14:25:37.824 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:37.825 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:37.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.874 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:37.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:37.874 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:25:37.874 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:25:37.877 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:37.919 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:37.919 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:37.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:37.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:37.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:37.920 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:37.921 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:37.949 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252326109184001) for scanner KuduScanner(table=replication_test_table, tablet=839b054b585245fba5afad723631f5a8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:25:37.949 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [0c4a60771d524aa0578e2de69586340c60f69d98f414cd4d6d01412fe01cea7b]
14:25:37.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0c4a60771d524aa0578e2de69586340c60f69d98f414cd4d6d01412fe01cea7b]
14:25:37.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:25:37.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:25:37.954 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] disconnecting while in state READY
14:25:37.955 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:37.955 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0c4a60771d524aa0578e2de69586340c60f69d98f414cd4d6d01412fe01cea7b finished by subtask 2; deferring removal (restored in pending)
14:25:37.984 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] handling channelInactive
14:25:37.984 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4be049df38da4388a5d46d454e4d7e92(127.17.128.3:42479)] cleaning up while in state READY due to: connection closed
14:25:37.985 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:25:37.985 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:25:38.002 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:38.003 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:38.003 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:38.003 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:38.003 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:38.003 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:38.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:38.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:38.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:38.004 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:38.004 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:38.004 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:38.004 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:38.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:38.148 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:38.148 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:38.148 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:38.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:38.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:38.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:38.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:38.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:38.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:38.151 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:38.151 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:38.151 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:38.151 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:38.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114338185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:38.198 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 01c353b3dfaac48d363fa91db2a11301 (2250 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:25:38.200 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:25:38.200 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 2ec2e84552394867a7cec0af624e9fca05e783c0b92ae320fbcef45b882175a0 from pending
14:25:38.200 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 0c4a60771d524aa0578e2de69586340c60f69d98f414cd4d6d01412fe01cea7b from pending
14:25:38.200 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 2 finished splits from enumerator state
14:25:38.265 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:38.266 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:38.266 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:38.266 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:38.266 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:38.266 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:38.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:38.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:38.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:38.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:38.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:38.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:38.267 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:38.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:38.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:38.313 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:38.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:38.315 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28056), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [34ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [35ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [47ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [143ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [200ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [881ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1863ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2183ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [4420ms] refreshing cache from master, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4421ms] too many traces: truncated at 100 traces, deferred=Deferred@1934454704(state=PENDING, result=null, callback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207), errback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207)))
14:25:38.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:25:38.316 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28056), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [34ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [35ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [47ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [143ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [200ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [881ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1863ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2183ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [4420ms] refreshing cache from master, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4421ms] too many traces: truncated at 100 traces, deferred=Deferred@1934454704(state=PENDING, result=null, callback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207), errback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.317 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
14:25:38.319 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
14:25:38.321 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28056), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [34ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [35ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [37ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [47ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [141ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [143ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [200ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [881ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [881ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1863ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2183ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [4420ms] refreshing cache from master, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4421ms] too many traces: truncated at 100 traces, deferred=Deferred@1934454704(state=PENDING, result=null, callback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207), errback=(continuation of Deferred@438404843 after retry RPC after error@942313074) -> (continuation of Deferred@458838728 after retry RPC after error@66166524) -> (continuation of Deferred@368137911 after retry RPC after error@2042893157) -> (continuation of Deferred@677036423 after retry RPC after error@668187662) -> (continuation of Deferred@940049069 after retry RPC after error@1628332530) -> (continuation of Deferred@531022509 after retry RPC after error@632237723) -> (continuation of Deferred@1573539305 after retry RPC after error@1339663955) -> (continuation of Deferred@1724098223 after retry RPC after error@985958170) -> (continuation of Deferred@904802478 after retry RPC after error@923263870) -> (continuation of Deferred@1284165103 after retry RPC after error@1390964531) -> (continuation of Deferred@382164608 after retry RPC after error@517161781) -> (continuation of Deferred@69992629 after retry RPC after error@355235572) -> (continuation of Deferred@968038799 after retry RPC after error@1031614311) -> (continuation of Deferred@1504754133 after retry RPC after error@794689473) -> (continuation of Deferred@235136196 after retry RPC after error@1515320436) -> (continuation of Deferred@116625658 after retry RPC after error@1183896594) -> (continuation of Deferred@1470381504 after retry RPC after error@42176788) -> (continuation of Deferred@418231806 after retry RPC after error@1478349493) -> (continuation of Deferred@773959243 after retry RPC after error@817140138) -> (continuation of Deferred@1157857287 after retry RPC after error@1933408872) -> (continuation of Deferred@1347273138 after retry RPC after error@1147151312) -> (continuation of Deferred@490373347 after retry RPC after error@97273622) -> (continuation of Deferred@993150540 after retry RPC after error@2122947673) -> (continuation of Deferred@939337459 after retry RPC after error@1357788141) -> (continuation of Deferred@2034704282 after retry RPC after error@1268662207)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.321 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:38.322 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
14:25:38.322 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
14:25:38.322 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:25:38.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:38.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:38.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:38.483 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:38.483 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.483 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.484 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:38.485 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [13ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [53ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [243ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [663ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1624ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2345ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@822841845(state=PENDING, result=null, callback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554), errback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554)))
14:25:38.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:25:38.486 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [13ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [53ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [243ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [663ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1624ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2345ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@822841845(state=PENDING, result=null, callback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554), errback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
14:25:38.488 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
14:25:38.490 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [13ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [47ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [53ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [53ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [63ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [243ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [662ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [663ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [663ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1624ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2345ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@822841845(state=PENDING, result=null, callback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554), errback=(continuation of Deferred@1287357208 after retry RPC after error@454414835) -> (continuation of Deferred@772837046 after retry RPC after error@1140405944) -> (continuation of Deferred@1397415580 after retry RPC after error@1717897039) -> (continuation of Deferred@1286225931 after retry RPC after error@1181545424) -> (continuation of Deferred@1138191295 after retry RPC after error@222712821) -> (continuation of Deferred@334684238 after retry RPC after error@849437587) -> (continuation of Deferred@1246981355 after retry RPC after error@1974818735) -> (continuation of Deferred@1908484551 after retry RPC after error@1220895127) -> (continuation of Deferred@429946960 after retry RPC after error@1190612196) -> (continuation of Deferred@1040239340 after retry RPC after error@1563086178) -> (continuation of Deferred@1204968559 after retry RPC after error@993966109) -> (continuation of Deferred@64049724 after retry RPC after error@144428793) -> (continuation of Deferred@1577048737 after retry RPC after error@323977043) -> (continuation of Deferred@445026228 after retry RPC after error@1287419419) -> (continuation of Deferred@1865779199 after retry RPC after error@132696237) -> (continuation of Deferred@700255435 after retry RPC after error@102673225) -> (continuation of Deferred@1163382282 after retry RPC after error@71031725) -> (continuation of Deferred@1159812277 after retry RPC after error@907471803) -> (continuation of Deferred@1296712941 after retry RPC after error@393611354) -> (continuation of Deferred@1480422141 after retry RPC after error@1500975474) -> (continuation of Deferred@1183140765 after retry RPC after error@1628876751) -> (continuation of Deferred@1385137034 after retry RPC after error@856876072) -> (continuation of Deferred@1604814964 after retry RPC after error@194718872) -> (continuation of Deferred@631668146 after retry RPC after error@28438154) -> (continuation of Deferred@1656103648 after retry RPC after error@807087554)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.491 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
14:25:38.491 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:38.492 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
14:25:38.599 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.599 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.599 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.600 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.601 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.601 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.601 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.601 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.601 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.601 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.602 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.603 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [11ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [12ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [33ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [142ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [322ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [582ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [582ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1064ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1925ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3620ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5000ms] refreshing cache from master, [5000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@922581384(state=PENDING, result=null, callback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255), errback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255)))
14:25:38.603 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.603 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.604 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.604 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.604 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [11ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [12ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [33ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [142ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [322ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [582ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [582ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1064ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1925ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3620ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5000ms] refreshing cache from master, [5000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@922581384(state=PENDING, result=null, callback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255), errback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [11ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [12ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [33ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [142ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [322ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [582ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [582ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1064ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1925ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3620ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5000ms] refreshing cache from master, [5000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@922581384(state=PENDING, result=null, callback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255), errback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.604 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.605 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.608 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [11ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [12ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [33ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [142ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [322ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [582ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [582ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1064ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1925ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3620ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5000ms] refreshing cache from master, [5000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@922581384(state=PENDING, result=null, callback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255), errback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28364), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [11ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [12ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [12ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [33ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [35ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [142ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [142ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [202ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [322ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [322ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [582ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [582ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1064ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1925ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3620ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3622ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [5000ms] refreshing cache from master, [5000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [5001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [5001ms] too many traces: truncated at 100 traces, deferred=Deferred@922581384(state=PENDING, result=null, callback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255), errback=(continuation of Deferred@1721619652 after retry RPC after error@219879683) -> (continuation of Deferred@1212742635 after retry RPC after error@363133523) -> (continuation of Deferred@496445399 after retry RPC after error@1217521255) -> (continuation of Deferred@1191828285 after retry RPC after error@1976420333) -> (continuation of Deferred@1363210012 after retry RPC after error@371558797) -> (continuation of Deferred@536635463 after retry RPC after error@76887802) -> (continuation of Deferred@1383797115 after retry RPC after error@1747489624) -> (continuation of Deferred@342519882 after retry RPC after error@962963163) -> (continuation of Deferred@857704517 after retry RPC after error@528576301) -> (continuation of Deferred@1487840439 after retry RPC after error@1281987079) -> (continuation of Deferred@66807407 after retry RPC after error@387418426) -> (continuation of Deferred@976292979 after retry RPC after error@986208408) -> (continuation of Deferred@1649969584 after retry RPC after error@1227719320) -> (continuation of Deferred@2077052250 after retry RPC after error@62506531) -> (continuation of Deferred@621464301 after retry RPC after error@1488278) -> (continuation of Deferred@287346515 after retry RPC after error@1558563722) -> (continuation of Deferred@801845081 after retry RPC after error@449086771) -> (continuation of Deferred@252431151 after retry RPC after error@2101410015) -> (continuation of Deferred@185049545 after retry RPC after error@903102599) -> (continuation of Deferred@1683470241 after retry RPC after error@514538996) -> (continuation of Deferred@672456193 after retry RPC after error@1070818300) -> (continuation of Deferred@1725964568 after retry RPC after error@568587437) -> (continuation of Deferred@789168710 after retry RPC after error@199330008) -> (continuation of Deferred@1819181149 after retry RPC after error@1377196001) -> (continuation of Deferred@862762007 after retry RPC after error@885808618) -> (continuation of Deferred@750280518 after retry RPC after error@1290906735) -> (continuation of Deferred@443250154 after retry RPC after error@1277052992) -> (continuation of Deferred@582122730 after retry RPC after error@1667317255)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:38.609 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:38.609 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
14:25:38.609 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
14:25:38.610 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:25:38.610 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
14:25:38.610 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:25:38.610 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
14:25:38.610 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
14:25:38.618 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:25:38.618 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
14:25:38.618 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.618 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:25:38.619 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.619 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.620 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.620 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.626 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.626 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.626 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.626 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
14:25:38.626 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
14:25:38.626 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
14:25:38.628 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:38.639 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.639 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.639 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.640 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:25:38.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
14:25:38.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
14:25:38.658 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
14:25:38.659 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
14:25:38.659 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.659 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.659 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.659 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
14:25:38.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.660 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
14:25:38.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.660 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:38.660 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:25:38.661 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.661 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.661 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:38.669411 17996 debug-util.cc:398] Leaking SignalData structure 0x7b080009e940 after lost signal to thread 17933
14:25:38.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:38.670164 17996 debug-util.cc:398] Leaking SignalData structure 0x7b080009c540 after lost signal to thread 17999
14:25:38.678 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.678 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.680 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114338686 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:38.694 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:38.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:25:38.703 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:38.703 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:38.703 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:38.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:38.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:38.703 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:38.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:38.703 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:38.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:38.704 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:38.704 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:38.704 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:38.704 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:38.718 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.718 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.718 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.719 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.719 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.719 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.719 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.719 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.719 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.719 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.771 [DEBUG - main] (Connection.java:575) [peer 4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)] disconnecting while in state READY
14:25:38.771 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.60:42293(127.17.128.60:42293)] disconnecting while in state READY
14:25:38.771 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.61:34199(127.17.128.61:34199)] disconnecting while in state READY
14:25:38.771 [DEBUG - main] (Connection.java:575) [peer c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)] disconnecting while in state READY
14:25:38.771 [DEBUG - main] (Connection.java:575) [peer master-127.17.128.62:37019(127.17.128.62:37019)] disconnecting while in state READY
14:25:38.771 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)] handling channelInactive
14:25:38.772 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 4c5a90a953ad4b5681643a81a5370633(127.17.128.1:37201)] cleaning up while in state READY due to: connection closed
14:25:38.772 [DEBUG - kudu-nio-4] (Connection.java:239) [peer c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)] handling channelInactive
14:25:38.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer c6ca421182684bf0990b55aa3bef06fc(127.17.128.2:44563)] cleaning up while in state READY due to: connection closed
14:25:38.772 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:38.772 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.128.60:42293(127.17.128.60:42293)] handling channelInactive
14:25:38.774 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state READY due to: connection closed
14:25:38.774 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
14:25:38.774 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-4
14:25:38.775 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
14:25:38.772 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.128.61:34199(127.17.128.61:34199)] handling channelInactive
14:25:38.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state READY due to: connection closed
14:25:38.775 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
14:25:38.778 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.128.62:37019(127.17.128.62:37019)] handling channelInactive
14:25:38.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state READY due to: connection closed
14:25:38.778 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:25:38.780 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.781 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.781 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:38.779747 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18201
14:25:38.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.784 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.784 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.784 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.784 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.803 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:38.803 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:38.803 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:38.804 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.804 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.804 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.804 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.804 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.804 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.804 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.804 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.804 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.805 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:38.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28505), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [6ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [12ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [14ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [14ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [21ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [22ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [24ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [43ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [60ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [83ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [201ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [461ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [781ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [782ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [782ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [782ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1543ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1543ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3520ms] refreshing cache from master, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3521ms] too many traces: truncated at 100 traces, deferred=Deferred@2078648140(state=PENDING, result=null, callback=(continuation of Deferred@1878350452 after retry RPC after error@1577441587) -> (continuation of Deferred@935084700 after retry RPC after error@1630883040) -> (continuation of Deferred@609651784 after retry RPC after error@1424627120) -> (continuation of Deferred@18285843 after retry RPC after error@1242434461) -> (continuation of Deferred@1512761944 after retry RPC after error@1592337208) -> (continuation of Deferred@1743751787 after retry RPC after error@1560754152) -> (continuation of Deferred@1358069306 after retry RPC after error@1192585215) -> (continuation of Deferred@1555169700 after retry RPC after error@955172269) -> (continuation of Deferred@2066644772 after retry RPC after error@401130785) -> (continuation of Deferred@1536903513 after retry RPC after error@362163242) -> (continuation of Deferred@491370211 after retry RPC after error@1280944550) -> (continuation of Deferred@1292497141 after retry RPC after error@1775919618) -> (continuation of Deferred@972304244 after retry RPC after error@945923445) -> (continuation of Deferred@980247764 after retry RPC after error@10345449) -> (continuation of Deferred@411753217 after retry RPC after error@762679144) -> (continuation of Deferred@2087650774 after retry RPC after error@314825505) -> (continuation of Deferred@1549748395 after retry RPC after error@1573945991) -> (continuation of Deferred@1502965086 after retry RPC after error@1426309022) -> (continuation of Deferred@1941946245 after retry RPC after error@706928591) -> (continuation of Deferred@1487906888 after retry RPC after error@270009228) -> (continuation of Deferred@508937629 after retry RPC after error@573943103) -> (continuation of Deferred@125676761 after retry RPC after error@1462361049) -> (continuation of Deferred@1734382988 after retry RPC after error@1756594186) -> (continuation of Deferred@46330529 after retry RPC after error@464262707), errback=(continuation of Deferred@1878350452 after retry RPC after error@1577441587) -> (continuation of Deferred@935084700 after retry RPC after error@1630883040) -> (continuation of Deferred@609651784 after retry RPC after error@1424627120) -> (continuation of Deferred@18285843 after retry RPC after error@1242434461) -> (continuation of Deferred@1512761944 after retry RPC after error@1592337208) -> (continuation of Deferred@1743751787 after retry RPC after error@1560754152) -> (continuation of Deferred@1358069306 after retry RPC after error@1192585215) -> (continuation of Deferred@1555169700 after retry RPC after error@955172269) -> (continuation of Deferred@2066644772 after retry RPC after error@401130785) -> (continuation of Deferred@1536903513 after retry RPC after error@362163242) -> (continuation of Deferred@491370211 after retry RPC after error@1280944550) -> (continuation of Deferred@1292497141 after retry RPC after error@1775919618) -> (continuation of Deferred@972304244 after retry RPC after error@945923445) -> (continuation of Deferred@980247764 after retry RPC after error@10345449) -> (continuation of Deferred@411753217 after retry RPC after error@762679144) -> (continuation of Deferred@2087650774 after retry RPC after error@314825505) -> (continuation of Deferred@1549748395 after retry RPC after error@1573945991) -> (continuation of Deferred@1502965086 after retry RPC after error@1426309022) -> (continuation of Deferred@1941946245 after retry RPC after error@706928591) -> (continuation of Deferred@1487906888 after retry RPC after error@270009228) -> (continuation of Deferred@508937629 after retry RPC after error@573943103) -> (continuation of Deferred@125676761 after retry RPC after error@1462361049) -> (continuation of Deferred@1734382988 after retry RPC after error@1756594186) -> (continuation of Deferred@46330529 after retry RPC after error@464262707)))
14:25:38.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.819 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.819 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.820 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:38.919 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:38.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:38.920 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:38.920 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.920 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.920 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:38.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:38.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.921 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.921 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:38.921 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:38.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:38.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:38.975 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:38.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:38.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:38.977 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.977 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.977 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:38.977 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:38.978 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28729), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [16ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [56ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [65ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [82ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [82ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [122ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [182ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [182ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [302ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [721ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [721ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [722ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [722ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1283ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1682ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1760ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1762ms] too many traces: truncated at 100 traces, deferred=Deferred@1502992765(state=PENDING, result=null, callback=(continuation of Deferred@812627926 after retry RPC after error@1250835044) -> (continuation of Deferred@1121337107 after retry RPC after error@897538053) -> (continuation of Deferred@2028181627 after retry RPC after error@1132838937) -> (continuation of Deferred@811094493 after retry RPC after error@2141755555) -> (continuation of Deferred@460126061 after retry RPC after error@1980000529) -> (continuation of Deferred@69208245 after retry RPC after error@1064760594) -> (continuation of Deferred@1130211854 after retry RPC after error@373559189) -> (continuation of Deferred@312854600 after retry RPC after error@443769195) -> (continuation of Deferred@886089201 after retry RPC after error@48118873) -> (continuation of Deferred@1048925122 after retry RPC after error@1073481024) -> (continuation of Deferred@246595683 after retry RPC after error@2105346328) -> (continuation of Deferred@1777487414 after retry RPC after error@914067533) -> (continuation of Deferred@777191225 after retry RPC after error@997332514) -> (continuation of Deferred@1074429060 after retry RPC after error@706311472) -> (continuation of Deferred@327941245 after retry RPC after error@946023208) -> (continuation of Deferred@731811580 after retry RPC after error@1246748234) -> (continuation of Deferred@116112234 after retry RPC after error@661711604) -> (continuation of Deferred@2026273160 after retry RPC after error@1288656212) -> (continuation of Deferred@396658508 after retry RPC after error@933488646) -> (continuation of Deferred@2086853955 after retry RPC after error@1244746350) -> (continuation of Deferred@2040279683 after retry RPC after error@1364661870) -> (continuation of Deferred@993345986 after retry RPC after error@2077738728) -> (continuation of Deferred@1674046267 after retry RPC after error@172647755) -> (continuation of Deferred@467668625 after retry RPC after error@1590000515) -> (continuation of Deferred@34069843 after retry RPC after error@1530822757) -> (continuation of Deferred@1076992277 after retry RPC after error@895351795), errback=(continuation of Deferred@812627926 after retry RPC after error@1250835044) -> (continuation of Deferred@1121337107 after retry RPC after error@897538053) -> (continuation of Deferred@2028181627 after retry RPC after error@1132838937) -> (continuation of Deferred@811094493 after retry RPC after error@2141755555) -> (continuation of Deferred@460126061 after retry RPC after error@1980000529) -> (continuation of Deferred@69208245 after retry RPC after error@1064760594) -> (continuation of Deferred@1130211854 after retry RPC after error@373559189) -> (continuation of Deferred@312854600 after retry RPC after error@443769195) -> (continuation of Deferred@886089201 after retry RPC after error@48118873) -> (continuation of Deferred@1048925122 after retry RPC after error@1073481024) -> (continuation of Deferred@246595683 after retry RPC after error@2105346328) -> (continuation of Deferred@1777487414 after retry RPC after error@914067533) -> (continuation of Deferred@777191225 after retry RPC after error@997332514) -> (continuation of Deferred@1074429060 after retry RPC after error@706311472) -> (continuation of Deferred@327941245 after retry RPC after error@946023208) -> (continuation of Deferred@731811580 after retry RPC after error@1246748234) -> (continuation of Deferred@116112234 after retry RPC after error@661711604) -> (continuation of Deferred@2026273160 after retry RPC after error@1288656212) -> (continuation of Deferred@396658508 after retry RPC after error@933488646) -> (continuation of Deferred@2086853955 after retry RPC after error@1244746350) -> (continuation of Deferred@2040279683 after retry RPC after error@1364661870) -> (continuation of Deferred@993345986 after retry RPC after error@2077738728) -> (continuation of Deferred@1674046267 after retry RPC after error@172647755) -> (continuation of Deferred@467668625 after retry RPC after error@1590000515) -> (continuation of Deferred@34069843 after retry RPC after error@1530822757) -> (continuation of Deferred@1076992277 after retry RPC after error@895351795)))
14:25:39.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:39.034231 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18375
14:25:39.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:39.092798 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18583
14:25:39.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:39.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:39.152704 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 17932
14:25:39.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114339185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:39.194 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.128.62:37019(127.17.128.62:37019)] handling channelInactive
14:25:39.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state READY due to: connection closed
14:25:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:39.194937 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18002
14:25:39.200 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:25:39.201 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:25:39.235 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.128.61:34199(127.17.128.61:34199)] handling channelInactive
14:25:39.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state READY due to: connection closed
14:25:39.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:39.236999 17920 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 18078
14:25:39.273 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.128.60:42293(127.17.128.60:42293)] handling channelInactive
14:25:39.273 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state READY due to: connection closed
14:25:39.319 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:39.319 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:39.319 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:39.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:39.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:39.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:39.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:39.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:39.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:39.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:39.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:39.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:39.321 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:39.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:39.376 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:39.376 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:39.377 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:39.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.377 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.377 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.377 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.377 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.377 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.378 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:39.429 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.431 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.17.128.60:42293(127.17.128.60:42293) for tablet Kudu Master: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.451 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.451 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.452 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.452 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.452 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.453 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.453 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.453 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.453 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.453 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.453 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.453 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.471 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.471 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.471 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.472 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.491 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.491 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.491 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.492 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.492 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.492 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.510 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.511 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.511 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.511 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.511 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.512 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.550 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.551 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.551 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.551 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.551 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.551 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.551 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.551 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.590 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.590 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.590 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.591 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.591 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.591 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:39.630 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.630 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.630 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.630 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.630 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.631 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.631 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.671 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.671 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.671 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.671 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114339685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:39.694 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:39.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:25:39.728 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:25:39.728 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:25:39.729 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
14:25:39.729 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:39.730 [INFO - Thread-51] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:39.730 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
14:25:39.730 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state TERMINATED
14:25:39.730 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state TERMINATED
14:25:39.730 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state TERMINATED
14:25:39.730 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:39.730 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:39.731 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.731 [INFO - Thread-51] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:39.731 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.731 [INFO - Thread-51] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:39.731 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.731 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.732 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.732 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
14:25:39.732 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:25:39.732 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.732 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.732 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.733 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:25:39.734 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:25:39.732 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
14:25:39.735 [DEBUG - Thread-51] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:39.735 [INFO - Thread-51] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:39.735 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:39.736 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
14:25:39.736 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:25:39.736 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
14:25:39.737 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
14:25:39.737 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:25:39.737 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
14:25:39.738 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:39.738 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:25:39.738 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:39.738 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
14:25:39.738 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:25:39.739 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:25:39.739 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.739 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
14:25:39.739 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
14:25:39.739 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:39.739 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:39.739 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:39.740 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:39.740 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@269ab390
14:25:39.740 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:39.740 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:39.740 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:25:39.740 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:25:39.742 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:25:39.743 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:25:39.743 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
14:25:39.743 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
14:25:39.743 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@70e62a67
14:25:39.743 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:39.743 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:39.744 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:25:39.744 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:25:39.746 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60d1193d
14:25:39.748 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:39.752 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5121d634
14:25:39.754 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:39.764 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:25:39.765 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:25:39.766 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.766 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
14:25:39.766 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
14:25:39.766 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.766 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.767 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@d3b6dc1
14:25:39.767 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:39.767 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:39.767 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:25:39.767 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:25:39.770 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18cb4bd5
14:25:39.770 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.772 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:39.776 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.776 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
14:25:39.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.777 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
14:25:39.778 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2e657152
14:25:39.778 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:39.778 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:25:39.779 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:25:39.779 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:25:39.782 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b8c8e3c
14:25:39.784 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:39.785 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.785 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.786 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.788 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.789 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.790 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.797 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.798 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.798 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.798 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.799 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.806 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.806 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.807 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.807 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.808 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.808 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.808 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.808 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.811 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.811 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.811 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.811 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.816 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.819 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.819 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.819 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.819 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.819 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.821 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.821 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.821 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.822 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.826 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.826 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.827 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.827 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.829 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.830 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.834 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.841 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.841 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.841 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.841 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.841 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.841 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.841 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.841 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.842 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.842 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.843 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.846 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.846 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.846 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.846 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.846 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.847 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.847 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.848 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.848 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.848 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.848 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.848 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.848 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.848 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.849 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.849 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.849 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.849 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.849 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.850 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.850 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.850 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.850 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.850 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.850 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.850 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.850 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.850 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.851 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.851 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.851 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.851 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.866 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.866 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.866 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.867 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.867 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.868 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.868 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.868 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.869 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.869 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.869 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.870 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.870 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.870 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.871 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.871 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.871 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.871 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.872 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.872 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:39.872 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.872 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.874 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.876 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.876 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.886 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.886 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.886 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.886 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.886 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.886 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.886 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.886 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.887 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.887 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.887 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.887 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.887 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.888 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.888 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.888 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.888 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.888 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.888 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.888 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.889 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.890 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.891 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.891 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.891 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.891 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.891 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.891 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.891 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.891 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.892 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.892 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.892 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.906 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.906 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.907 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.907 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.907 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.907 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.907 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.907 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.908 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.908 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.908 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.908 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.908 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.908 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.908 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.908 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.909 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.909 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.909 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.909 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.909 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.910 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.910 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.910 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.911 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.911 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.911 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.911 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.911 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.911 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.911 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.911 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.911 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.913 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:39.914 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:39.914 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:39.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.914 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.914 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.915 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:39.926 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.926 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.926 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.926 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.926 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.927 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.927 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.928 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.929 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.929 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.929 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.929 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.930 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.930 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.930 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.930 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.931 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.931 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.931 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.931 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.931 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:39.931 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:39.932 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:39.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:39.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:39.932 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:39.933 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:39.947 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.947 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.948 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.948 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.948 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.948 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.948 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.948 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.948 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.949 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.949 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.951 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.951 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.951 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.951 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.951 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.951 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.951 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.951 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.951 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.951 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:39.966 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:39.966 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:39.966 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:39.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:39.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:39.967 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:39.967 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.967 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.967 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.967 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.967 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.967 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.967 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.967 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.967 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:39.985 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:39.985 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:39.986 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:39.986 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.986 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:39.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.986 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:39.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:39.986 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:39.986 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:39.987 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:39.987 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:39.987 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.987 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.987 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:39.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:39.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:39.988 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:40.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.007 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.008 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.008 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.008 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.008 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.009 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.009 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.009 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.010 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.010 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.010 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.010 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.010 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.010 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.010 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.011 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.011 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.011 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.011 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.046 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:40.047 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:40.047 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:40.047 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.047 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.047 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.047 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.047 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:40.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.049 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.049 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.049 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.050 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.050 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.050 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.050 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.086 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.086 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.086 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.086 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.086 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.086 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.087 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.087 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.087 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.087 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.088 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.089 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.089 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.089 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.089 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.089 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.090 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.090 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.111 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.111 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.111 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.111 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.111 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.111 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.111 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.111 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.112 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.112 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.112 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114340185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:40.186 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:40.186 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:40.186 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:40.187 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.187 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.187 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:40.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.187 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.187 [INFO - pool-336-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:40.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:40.188 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:40.197 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:40.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:25:40.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.246 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.246 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.246 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.247 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.247 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.247 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.247 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.247 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.267 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.268 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.268 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.268 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.298 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:40.299 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:40.299 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:40.299 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:40.299 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:40.299 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:40.299 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:40.299 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:40.299 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:40.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:40.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:40.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:40.300 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:40.310 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.310 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.311 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.311 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.311 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.311 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.311 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.366 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.367 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.367 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.367 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.368 [INFO - pool-340-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.368 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.368 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.401 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:40.402 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:40.402 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:40.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:40.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:40.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:40.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:40.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:40.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:40.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:40.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:40.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:40.403 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:40.426 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.426 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.427 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.427 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.427 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.427 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.427 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.427 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.427 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:40Z chronyd exiting
14:25:40.459 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:40.459 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:40.459 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:40.459 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:40.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:40.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:40.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:40.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:40.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:40.459 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:40.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:40.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:40.460 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:40.607 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.607 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.608 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.608 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114340685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:40.692 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:25:40.693 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:25:40.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.769 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.770 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.770 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.770 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.771 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:40.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:40.911 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:40.911 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:40.911 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:40.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:40.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:40.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:40.912 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:41.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:41.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:41.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:41.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:41.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:41.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:41.012 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:41.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:41.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:41.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:41.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:41.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:41.012 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:41.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114341185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:41.192 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:25:41.193 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:25:41.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.227 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:41.227 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:41.227 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:41.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.228 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.228 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:41.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.466 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:41.466 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:41.466 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:41.467 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:41.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:41.467 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:41.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:41.467 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:41.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:41.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:41.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:41.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:41.467 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
.14:25:41.475 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114341475
14:25:41.475 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114341475
14:25:41.480 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:25:41.484 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:25:41.484 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:25:41.485 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:25:41.485 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:25:41.485 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:25:41.488 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:25:41.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:41.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:41.506 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:41.506 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.506 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.506 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.506 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.506 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.506 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.506 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.506 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.506 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.506 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:41.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114341685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:41.693 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:41.694 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:25:41.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:41.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:41.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:41.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.735 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:41.735 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.735 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:41.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:41.735 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:41.820 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:41.820 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:25:41.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:41.823246 20048 mini_oidc.cc:150] Starting JWKS server
14:25:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:41.826452 20048 webserver.cc:533] Webserver started at http://127.0.0.1:40845/ using document root <none> and password file <none>
14:25:41.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:41.826956 20048 mini_oidc.cc:186] Starting OIDC Discovery server
14:25:41.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:41.828675 20048 webserver.cc:533] Webserver started at http://127.0.0.1:36565/ using document root <none> and password file <none>
14:25:41.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:25:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:41Z Disabled control of system clock
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:41.893123 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/logs
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data/info.pb
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.62:34807
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.62
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:41.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json with env {}
14:25:41.950 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:41.950 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:41.951 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:41.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.951 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.951 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.951 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.951 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.951 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:41.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:41.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:41.966 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:41.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:41.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:41.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:41.967 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:42.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:42.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:42.079 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:42.080 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:42.080 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:42.080 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:42.080 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:42.080 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:42.080 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:42.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:42.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:42.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:42.080 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:42.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:42.139 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:42.139 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:42.139 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:42.139 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:42.139 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:42.139 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:42.139 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:42.139 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:42.140 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:42.140 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:42.140 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:42.140 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:42.140 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:42.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114342185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:42.197 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:42.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:25:42.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:42.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.223477 20060 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:42.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.224080 20060 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:42.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.224545 20060 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.256857 20060 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.257086 20060 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.257261 20060 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.257434 20060 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.257599 20060 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:42.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.257735 20060 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40845/jwks.json
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:42.293139 20060 master_runner.cc:387] Master server non-default flags:
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.62:34807
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data/info.pb
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.62
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/logs
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:42.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:42.294477 20060 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:42.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:42.296030 20060 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:42.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.307492 20066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:42.351 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:42.351 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:42.351 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:42.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:42.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:42.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:42.353 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:42.353 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:42.353 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:42.353 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:42.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:42.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:42.353 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:42.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:42.409 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:42.409 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:42.409 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:42.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.411 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:42.531 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:42.531 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:42.531 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:42.532 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.532 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.533 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.533 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.533 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.533 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.533 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.533 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:42.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:42.669 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:42.669 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:42.669 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:42.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.672 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.672 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.672 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:42.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114342685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:42.698 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:25:42.699 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:25:42.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:42.763 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:42.763 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:42.764 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:42.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:42.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:42.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:42.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:42.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:42.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:42.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:42.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:42.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:42.765 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:42.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:42.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:42.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:42.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:42.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:42.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:42.769 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:42.874 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114343186 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:43.187 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:43.187 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:43.188 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:43.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.189 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.189 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.189 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.189 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:43.204 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:25:43.205 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:25:43.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.246 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:43.246 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:43.246 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:43.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.246 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.247 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:43.276 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:43.276 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:43.277 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:43.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.277 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.277 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:43.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:43.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.278 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:43.278 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:43.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114343685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:43.697 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:25:43.698 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:25:43.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.710870 20065 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 20060
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.741406 20065 kernel_stack_watchdog.cc:198] Thread 20060 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.742274 20060 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.434s	user 0.505s	sys 0.924s
14:25:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.743036 20060 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.435s	user 0.505s	sys 0.924s
14:25:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:42.308149 20067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:43.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.744568 20069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:43.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.747604 20068 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1434 milliseconds
14:25:43.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.747623 20060 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:43.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.748795 20060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.751286 20060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:43.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.752692 20060 hybrid_clock.cc:648] HybridClock initialized: now 1779114343752633 us; error 60 us; skew 500 ppm
14:25:43.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.753429 20060 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:43.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.759502 20060 webserver.cc:533] Webserver started at http://127.19.148.62:37311/ using document root <none> and password file <none>
14:25:43.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.760478 20060 fs_manager.cc:362] Metadata directory not provided
14:25:43.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.760732 20060 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:43.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.761268 20060 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:43.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:43.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:43.762 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:43.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:43.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:43.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:43.762 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:43.762 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:43.762 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:43.762 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:43.762 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:43.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:43.763 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:43.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.766120 20060 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data/instance:
14:25:43.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce679dc264f34c2b988d0c0bff2338a0"
14:25:43.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:43 on dist-test-slave-1n46"
14:25:43.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.767409 20060 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal/instance:
14:25:43.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce679dc264f34c2b988d0c0bff2338a0"
14:25:43.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:43 on dist-test-slave-1n46"
14:25:43.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.774142 20060 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
14:25:43.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.779343 20076 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:43.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.780356 20060 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.780690 20060 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce679dc264f34c2b988d0c0bff2338a0"
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:43 on dist-test-slave-1n46"
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.781020 20060 fs_report.cc:389] FS layout report
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data/data
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:43.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:43.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.833925 20060 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:43.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.835405 20060 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:43.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.835896 20060 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:43.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:43.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:43.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:43.866 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.866 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.866 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.867 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:43.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:43.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.908099 20060 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.62:34807
14:25:43.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.908176 20127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.62:34807 every 8 connection(s)
14:25:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.910980 20060 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/data/info.pb
14:25:43.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.916998 20128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:43.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.919723 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20060
14:25:43.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.920154 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-0/wal/instance
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.923544 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/logs
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data/info.pb
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.61:37523
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.61
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:43.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json with env {}
14:25:43.927 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:43.927 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:43.927 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:43.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:43.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:43.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:43.928 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:43.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.928409 20128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } has no permanent_uuid. Determining permanent_uuid...
14:25:43.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:43.957846 20128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } has no permanent_uuid. Determining permanent_uuid...
14:25:43.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.960526 20077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:43.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:43.964882 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.014417 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 1
14:25:44.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.018146 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.086602 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 2
14:25:44.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.091912 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.170 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:44.171 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:44.171 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:44.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:44.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:44.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:44.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:44.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:44.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:44.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:44.171 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:44.171 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:44.171 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:44.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.183331 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 3
14:25:44.185 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114344185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.189208 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.193 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:25:44.193 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:25:44.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.244133 20130 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:44.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.244777 20130 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:44.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.245313 20130 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:44.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.276340 20130 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:44.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.276659 20130 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:44.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.276988 20130 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:44.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.277307 20130 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:44.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.277594 20130 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:44.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.277830 20130 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40845/jwks.json
14:25:44.287 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:44.287 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:44.288 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:44.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.288 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.313091 20130 master_runner.cc:387] Master server non-default flags:
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.61:37523
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data/info.pb
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.61
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/logs
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:44.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.314394 20130 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:44.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.315876 20130 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:44.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.326421 20139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:44.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.332656 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 4
14:25:44.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.336911 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.343 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:44.343 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:44.343 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:44.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:44.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:44.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:44.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:44.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:44.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:44.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:44.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:44.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:44.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:44.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:44.636348 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 5
14:25:44.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.644337 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:44.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114344685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:44.686 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:44.686 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:44.687 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:44.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:44.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:44.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:44.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:44.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:44.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:44.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:44.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:44.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:44.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:44.689 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:44.689 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:44.689 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:44.690 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:44.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:44.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:44.692 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:44.703 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:25:44.704 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:25:44.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.734 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:44.735 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:44.735 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:44.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:44.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:44.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:44.735 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:44.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:44.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:44.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:44.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:44.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:44.735 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:44.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:44.899 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:44.900 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:44.900 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:44.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:44.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:44.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:44.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:44.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:44.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:44.901 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:44.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:44.901 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:44.901 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:45.126 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114345185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:45.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:45.191865 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 6
14:25:45.195 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:45.195 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:45.196 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:45.196 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.196 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.197 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.197 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.197 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:25:45.195 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.197 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.197 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.197 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.197 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.197 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:45.199 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:25:45.218 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:45.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.219 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:45.219 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:45.219 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.219 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.219 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.219 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.219 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.219 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.220 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:45.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:45.232270 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:45.363 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:45.363 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:45.363 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:45.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:45.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:45.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:45.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:45.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.410 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:45.410 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:45.410 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:45.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:45.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:45.411 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:45.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:45.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:45.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:45.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:45.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:45.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:45.411 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:45.489 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:45.489 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:45.489 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:45.490 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.490 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.490 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.491 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:45.606 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:45.606 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:45.606 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:45.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:45.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:45.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.608 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:45.608 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:45.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114345685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:45.691 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:45.691 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:45.691 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:45.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.692 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.692 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.692 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:45.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.692 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.692 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.692 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:45.693 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:45.696 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:25:45.699 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:25:45.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:45.883 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:25:45.884 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:25:45.884 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
14:25:45.885 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:45.886 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
14:25:45.887 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
14:25:45.888 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:25:45.888 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
14:25:45.888 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:45.888 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:45.888 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:25:45.889 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
14:25:45.889 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:25:45.890 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
14:25:45.890 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:25:45.890 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:45.892 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:25:45.892 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:25:45.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
14:25:45.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
14:25:45.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@121ff7e7
14:25:45.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:45.893 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:45.894 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
14:25:45.895 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
14:25:45.895 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:25:45.895 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
14:25:45.898 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:45.899 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
14:25:45.899 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:25:45.899 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b1ce91a
14:25:45.900 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
14:25:45.902 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:45.905 [INFO - Thread-53] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:45.905 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:25:45.905 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:25:45.905 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:25:45.906 [DEBUG - Thread-53] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:45.910 [INFO - Thread-53] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:45.910 [INFO - Thread-53] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:45.915 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:25:45.932 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:25:45.937 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
14:25:45.937 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
14:25:45.944 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:45.944 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:45.945 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:45.948 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.948 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:45.952 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.952 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.952 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:45.960 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:45.974 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:45.975 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:45.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:45.995 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.004 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:46.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.005 [INFO - pool-344-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.005 [WARN - pool-344-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:46.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:46.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:46.005 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:46.005 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:46.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@133c1d92
14:25:46.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:46.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:46.010 [DEBUG - Thread-53] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:46.011 [INFO - Thread-53] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:46.011 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:25:46.011 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:25:46.016 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:25:46.019 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:25:46.019 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.019 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.020 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
14:25:46.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.020 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
14:25:46.021 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.022 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60e29287
14:25:46.023 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:46.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.023 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:46.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.023 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.024 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64513392
14:25:46.025 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
14:25:46.025 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
14:25:46.032 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:46.035 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10ae40fc
14:25:46.037 [ERROR - Source: KuduSource -> Sink: Writer (3/4)#6] (HashedWheelTimer.java:470) You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the JVM, so that only a few instances are created.
14:25:46.040 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
14:25:46.040 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
14:25:46.042 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:46.043 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.043 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29b266ed
14:25:46.043 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:46.043 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:25:46.044 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:46.044 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:46.044 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:46.044 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:46.047 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
14:25:46.048 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
14:25:46.140 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.141 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.142 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.142 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:46.142 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:46.143 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:46.143 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.143 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.143 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.143 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.143 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.143 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.143 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.143 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.144 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.144 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.146 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.146 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.146 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:46.147 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.147 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.147 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1bbced07
14:25:46.150 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:46.151 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.151 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.151 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.153 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.153 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.154 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.154 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.154 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.154 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.154 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.155 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.156 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.160 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.162 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.164 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.167 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.174 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:46.174 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:46.174 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:46.175 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.175 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.175 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.175 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.175 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.175 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.176 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.176 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:46.176 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.176 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.179 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.185 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114346186 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:46.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.196 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.196 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.199 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:25:46.201 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:25:46.203 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.203 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.203 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.203 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.203 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.205 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.206 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.206 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.207 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.207 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.208 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.209 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.209 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.210 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.212 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.214 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.214 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.216 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.218 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.218 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.218 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.218 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.219 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.220 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.222 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.223 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.224 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.224 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.224 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.224 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.225 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.228 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.228 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.229 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.229 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.229 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.229 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.232 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.233 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.233 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.233 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.234 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.234 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.235 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.235 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.235 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.235 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.235 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.237 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.240 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.240 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.240 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.240 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.241 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.242 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.243 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.243 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.243 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.243 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.243 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.243 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.243 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.243 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.245 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.246 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.246 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.248 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.251 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.253 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.254 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.254 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.254 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.254 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.254 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.256 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.256 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.256 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.256 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.256 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.256 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.256 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.256 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.260 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.262 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.263 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.263 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.263 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.263 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.266 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.266 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.266 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.266 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.266 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.266 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.266 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.266 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.266 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.266 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.266 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.267 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.268 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.269 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.269 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.269 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.276 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.277 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.277 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.278 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.288 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.289 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.289 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.289 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.290 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.292954 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 7
14:25:46.295 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.295 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.295 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.296 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.296 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.296 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.296 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.296 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.297 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.297 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.297 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.297 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.297 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.297 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.297 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.300 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.301 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.302 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.302 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.303 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.303 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.303 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.303 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.316999 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.61:37523: Network error: Client connection negotiation failed: client connection to 127.19.148.61:37523: connect: Connection refused (error 111)
14:25:46.328 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.328 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.328 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.328 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.328 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.328 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.328 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.329 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.337 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.337 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.337 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.338 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.338 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.338 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.355 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.355 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.355 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.355 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.356 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.356 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.356 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.356 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.356 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.360 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.360 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.360 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.361 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.361 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.362 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.362 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.362 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.362 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.362 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.362 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.363 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.363 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:45.731710 20138 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 20130
14:25:46.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:44.327291 20140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:46.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.369448 20130 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.043s	user 0.670s	sys 1.280s
14:25:46.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.369834 20130 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.043s	user 0.670s	sys 1.280s
14:25:46.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.371680 20142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:46.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.375648 20141 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2039 milliseconds
14:25:46.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.375730 20130 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:46.376 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.377 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.377 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.377 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.377 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.378 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.377311 20130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:46.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.379935 20130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:46.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.381273 20130 hybrid_clock.cc:648] HybridClock initialized: now 1779114346381229 us; error 29 us; skew 500 ppm
14:25:46.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.382153 20130 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:46.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.389479 20130 webserver.cc:533] Webserver started at http://127.19.148.61:39365/ using document root <none> and password file <none>
14:25:46.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.390362 20130 fs_manager.cc:362] Metadata directory not provided
14:25:46.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.390599 20130 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:46.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.391054 20130 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.395694 20130 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data/instance:
14:25:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44b8fa7d7b2341dd96c18e0a22673623"
14:25:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:46 on dist-test-slave-1n46"
14:25:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.396749 20130 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal/instance:
14:25:46.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44b8fa7d7b2341dd96c18e0a22673623"
14:25:46.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:46 on dist-test-slave-1n46"
14:25:46.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.404841 20130 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.005s
14:25:46.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.409 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.410 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.411701 20207 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:46.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.412776 20130 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.413018 20130 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "44b8fa7d7b2341dd96c18e0a22673623"
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:46 on dist-test-slave-1n46"
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.413301 20130 fs_report.cc:389] FS layout report
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data/data
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:46.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.421 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.421 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.421 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.421 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.421 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.421 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.421 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.421 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.422 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.422 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.422 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.422 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.463 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.463 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.463 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.464 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.464 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.464 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.464 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.464 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.464 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.464 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.464 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.464 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.464 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.471184 20130 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:46.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.472633 20130 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:46.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.472993 20130 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:46.475 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.475 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.475 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.476 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.476 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.477 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.477 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.477 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.477 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.477 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.477 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.478 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.478 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.516 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:46.517 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:46.517 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:46.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:46.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.517 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.517 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:46.518 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.518 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.518 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:46.518 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:46.546 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:46.546 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:46.546 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:46.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:46.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:46.547 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:46.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:46.547 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:46.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:46.547 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:46.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:46.547 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:46.547 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:46.548 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.548 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.548 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.550 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.558518 20130 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.61:37523
14:25:46.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.558620 20258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.61:37523 every 8 connection(s)
14:25:46.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.561124 20130 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/data/info.pb
14:25:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.567214 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20130
14:25:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.567523 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-1/wal/instance
14:25:46.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.568172 20259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.569756 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/logs
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data/info.pb
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.60:37365
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.60
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:46.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json with env {}
14:25:46.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.581507 20259 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } has no permanent_uuid. Determining permanent_uuid...
14:25:46.600 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.600 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.601 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.601 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.601 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.604478 20259 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } has no permanent_uuid. Determining permanent_uuid...
14:25:46.616 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.617 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.617 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.617 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.618 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.619268 20259 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
14:25:46.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.622730 20209 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:46.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.627528 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:46.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.677034 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 1
14:25:46.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.682126 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:46.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114346685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:46.693 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:46.694 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:25:46.695 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.695 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.695 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.702 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.703 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.703 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.703 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.703 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.703 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.703 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.737 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.737 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.737 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.737 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.737 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.737 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.738 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.750555 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 2
14:25:46.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.755175 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:46.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.809 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.846591 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 3
14:25:46.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.851532 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:46.863 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.863 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.863 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.863 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.863 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.863 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.864 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:46.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:46.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:46.868 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.868 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.868 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:46.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:46.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:46.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:46.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:46.926 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:46.926 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:46.927 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:46.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:46.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:46.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:46.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:46.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:46.927 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.937589 20261 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:46.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.938189 20261 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:46.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.938704 20261 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:46.940 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:46.940 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:46.940 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:46.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.940 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.940 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.940 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:46.940 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:46.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:46.940 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:46.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.972244 20261 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:46.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.972610 20261 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:46.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.972836 20261 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:46.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.973016 20261 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:46.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.973191 20261 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:46.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.973323 20261 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40845/jwks.json
14:25:46.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:46.995023 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 4
14:25:46.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:46.998811 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:47.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:47.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:47.007 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:47.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.008 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:47.012957 20261 master_runner.cc:387] Master server non-default flags:
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.60:37365
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40845/jwks.json
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data/info.pb
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.60
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/logs
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:47.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:47.014653 20261 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:47.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:47.016561 20261 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:47.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:47.027484 20271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:47.042 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:47.042 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:47.042 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:47.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:47.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:47.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:47.043 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:47.043 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:47.043 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:47.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:47.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:47.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:47.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:47.054 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.054 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.055 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.055 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.055 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.083 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:47.084 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:47.084 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:47.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:47.084 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:47.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:47.084 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:47.084 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:47.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:47.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:47.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:47.084 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:47.085 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:47.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.143 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.143 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.143 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.145 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.166 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:47.167 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:47.167 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:47.167 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.167 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.167 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.168 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.168 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.168 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.169 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:47.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114347185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:47.202 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:25:47.204 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:25:47.214 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.221 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.222 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.222 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.223 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:47.298189 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 5
14:25:47.303 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.304 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.304 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.305 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.305 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.306 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:47.311973 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:47.320 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:47.320 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:47.321 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:47.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:47.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:47.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:47.322 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:47.322 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:47.322 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:47.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:47.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:47.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:47.322 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:47.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.474 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:47.474 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:47.474 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:47.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.476 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:47.596 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:47.596 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:47.597 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:47.597 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.597 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.597 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:47.598 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.598 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.598 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:47.598 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.598 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:47.598 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:47.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.647 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:47.647 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:47.647 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:47.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.649 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.649 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.649 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.649 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:47.654 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.654 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.655 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.655 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.656 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.656 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114347685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:47.702 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:25:47.703 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:25:47.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.737 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.737 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.737 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.737 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.738 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.738 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.738 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.738 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.738 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.738 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:47.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:47.768 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:47.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:47.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:47.769 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:47.769 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:47.769 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:47.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:47.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.771 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.771 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:47.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:47.771 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:47.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:47.772 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:47.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:47.859493 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 6
14:25:47.873 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:47.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:47.901288 20259 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:48.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114348185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:48.194 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:48.196 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:25:48.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:47.027995 20272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:48.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.368734 20274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:48.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.371222 20273 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1338 milliseconds
14:25:48.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.371984 20261 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.344s	user 0.483s	sys 0.817s
14:25:48.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.372368 20261 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.345s	user 0.483s	sys 0.817s
14:25:48.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.372634 20261 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:48.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.374169 20261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:48.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.377590 20261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:48.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.379052 20261 hybrid_clock.cc:648] HybridClock initialized: now 1779114348378989 us; error 43 us; skew 500 ppm
14:25:48.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.380297 20261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:48.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.389756 20261 webserver.cc:533] Webserver started at http://127.19.148.60:38933/ using document root <none> and password file <none>
14:25:48.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.391450 20261 fs_manager.cc:362] Metadata directory not provided
14:25:48.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.391808 20261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:48.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.392477 20261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:48.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.399991 20261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data/instance:
14:25:48.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e7edbd45703d47b8a690329b7bc289be"
14:25:48.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:48 on dist-test-slave-1n46"
14:25:48.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.401602 20261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal/instance:
14:25:48.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e7edbd45703d47b8a690329b7bc289be"
14:25:48.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:48 on dist-test-slave-1n46"
14:25:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.407437 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } attempt: 8
14:25:48.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.422871 20261 fs_manager.cc:696] Time spent creating directory manager: real 0.020s	user 0.006s	sys 0.014s
14:25:48.430 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:48.431 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:48.431 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:48.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:48.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:48.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:48.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.431550 20128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
14:25:48.432 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:48.432 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:48.432 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:48.433 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:48.433 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:48.433 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:48.433 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:48.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.438418 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:48.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.438625 20285 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:48.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.440042 20261 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.007s	sys 0.003s
14:25:48.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.440415 20261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal
14:25:48.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e7edbd45703d47b8a690329b7bc289be"
14:25:48.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:48 on dist-test-slave-1n46"
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.440789 20261 fs_report.cc:389] FS layout report
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data/data
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:48.486 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:48.486 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:48.486 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:48.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:48.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:48.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:48.487 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:48.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:48.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:48.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:48.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:48.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:48.487 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:48.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:48.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:48.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:48.497 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:48.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:48.497 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:48.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:48.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:48.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:48.497 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:48.497 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:48.497 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:48.497 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:48.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.503863 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 1
14:25:48.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.509061 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:48.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.522182 20261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:48.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.523833 20261 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:48.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.524266 20261 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:48.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.562451 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 2
14:25:48.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.569770 20128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.148.60:37365: Network error: Client connection negotiation failed: client connection to 127.19.148.60:37365: connect: Connection refused (error 111)
14:25:48.578 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:48.579 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:48.579 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:48.579 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:48.579 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:48.579 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:48.579 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:48.579 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:48.579 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:48.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:48.579 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:48.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:48.580 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:48.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.610019 20261 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.60:37365
14:25:48.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.610131 20337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.60:37365 every 8 connection(s)
14:25:48.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.612914 20261 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/data/info.pb
14:25:48.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.619239 20338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:48.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.621271 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20261
14:25:48.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.621652 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/master-2/wal/instance
14:25:48.629 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.632714 20338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } has no permanent_uuid. Determining permanent_uuid...
14:25:48.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.647065 20128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 3
14:25:48.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.658746 20338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } has no permanent_uuid. Determining permanent_uuid...
14:25:48.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.672755 20128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: Bootstrap starting.
14:25:48.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.672812 20338 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
14:25:48.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.679594 20128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: Neither blocks nor log segments found. Creating new log.
14:25:48.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.682070 20128 log.cc:826] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: Log is configured to *not* fsync() on all Append() calls
14:25:48.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114348685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:48.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.688349 20128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: No bootstrap required, opened a new log
14:25:48.694 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:48.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:25:48.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.694756 20338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: Bootstrap starting.
14:25:48.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.703541 20338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: Neither blocks nor log segments found. Creating new log.
14:25:48.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.705585 20338 log.cc:826] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: Log is configured to *not* fsync() on all Append() calls
14:25:48.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.711776 20338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: No bootstrap required, opened a new log
14:25:48.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.717361 20128 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.717955 20128 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:48.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.718438 20128 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce679dc264f34c2b988d0c0bff2338a0, State: Initialized, Role: FOLLOWER
14:25:48.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.719343 20128 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.722535 20348 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.723351 20348 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: This master's current role is: FOLLOWER
14:25:48.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.724664 20128 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: configured and running, proceeding with master startup.
14:25:48.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.734076 20338 raft_consensus.cc:359] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.734807 20338 raft_consensus.cc:385] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:48.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.735080 20338 raft_consensus.cc:740] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7edbd45703d47b8a690329b7bc289be, State: Initialized, Role: FOLLOWER
14:25:48.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.735807 20338 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.739375 20354 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.740376 20354 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: This master's current role is: FOLLOWER
14:25:48.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.741261 20338 sys_catalog.cc:565] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: configured and running, proceeding with master startup.
14:25:48.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.766094 20365 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:25:48.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.766403 20365 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:25:48.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.779670 20292 tablet.cc:2404] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:48.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.784873 20354 raft_consensus.cc:493] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:25:48.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.785399 20354 raft_consensus.cc:515] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.791 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:48.791 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:48.791 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:48.791 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:48.792 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:48.792 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:48.792 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:48.792 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:48.792 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:48.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:48.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:48.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:48.794 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.793958 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7edbd45703d47b8a690329b7bc289be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce679dc264f34c2b988d0c0bff2338a0" is_pre_election: true
14:25:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.795444 20103 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7edbd45703d47b8a690329b7bc289be in term 0.
14:25:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.796190 20354 leader_election.cc:290] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce679dc264f34c2b988d0c0bff2338a0 (127.19.148.62:34807), 44b8fa7d7b2341dd96c18e0a22673623 (127.19.148.61:37523)
14:25:48.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.797093 20290 leader_election.cc:304] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce679dc264f34c2b988d0c0bff2338a0, e7edbd45703d47b8a690329b7bc289be; no voters: 
14:25:48.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.764289 20060 master_runner.cc:187] Error getting master registration for 127.19.148.61:37523: OK, instance_id { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" instance_seqno: 1779114346535642 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:48.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.798249 20354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Leader pre-election won for term 1
14:25:48.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.799172 20060 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:48.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.799191 20354 raft_consensus.cc:493] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:25:48.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.799815 20354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 0 FOLLOWER]: Advancing to term 1
14:25:48.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.807191 20354 raft_consensus.cc:515] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.809800 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7edbd45703d47b8a690329b7bc289be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce679dc264f34c2b988d0c0bff2338a0"
14:25:48.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.810334 20103 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 0 FOLLOWER]: Advancing to term 1
14:25:48.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.816797 20354 leader_election.cc:290] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [CANDIDATE]: Term 1 election: Requested vote from peers ce679dc264f34c2b988d0c0bff2338a0 (127.19.148.62:34807), 44b8fa7d7b2341dd96c18e0a22673623 (127.19.148.61:37523)
14:25:48.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.817903 20103 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7edbd45703d47b8a690329b7bc289be in term 1.
14:25:48.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.818596 20372 catalog_manager.cc:1594] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:25:48.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.819602 20372 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:25:48.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.825994 20290 leader_election.cc:304] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce679dc264f34c2b988d0c0bff2338a0, e7edbd45703d47b8a690329b7bc289be; no voters: 
14:25:48.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.827214 20354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 1 FOLLOWER]: Leader election won for term 1
14:25:48.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.790205 20261 master_runner.cc:187] Error getting master registration for 127.19.148.61:37523: OK, instance_id { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" instance_seqno: 1779114346535642 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:25:48.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.846102 20261 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:25:48.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.847018 20354 raft_consensus.cc:697] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [term 1 LEADER]: Becoming Leader. State: Replica: e7edbd45703d47b8a690329b7bc289be, State: Running, Role: LEADER
14:25:48.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:48.847703 20082 tablet.cc:2404] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:48.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.847911 20354 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:48.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.862340 20374 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7edbd45703d47b8a690329b7bc289be. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.863673 20374 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: This master's current role is: LEADER
14:25:48.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.867674 20376 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:25:48.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:48.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.879261 20376 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:25:48.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.899951 20103 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [term 1 FOLLOWER]: Refusing update from remote peer e7edbd45703d47b8a690329b7bc289be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:48.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.904722 20374 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:48.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.940035 20348 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7edbd45703d47b8a690329b7bc289be. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.940795 20348 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: This master's current role is: FOLLOWER
14:25:48.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.944586 20377 mvcc.cc:204] Tried to move back new op lower bound from 7287252373074665472 to 7287252372891619328. Current Snapshot: MvccSnapshot[applied={T|T < 7287252373074665472}]
14:25:48.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.958076 20348 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.958743 20348 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0 [sys.catalog]: This master's current role is: FOLLOWER
14:25:48.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.958829 20354 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:48.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.959543 20354 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: This master's current role is: LEADER
14:25:48.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.961817 20259 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } attempt: 7
14:25:48.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.964884 20376 catalog_manager.cc:1383] Generated new cluster ID: 1b5b8c2448b4410b8a488ddc6a807ab3
14:25:48.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:48.965152 20376 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:25:49.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:49.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:49.011 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:49.011 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:49.011 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:49.011 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:49.012 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:49.012 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:49.012 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:49.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:49.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:49.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:49.012 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:49.029 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:49.029 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:49.030 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:49.030 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.030 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.030 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.030 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.030 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:49.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.047184 20259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: Bootstrap starting.
14:25:49.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.053634 20376 catalog_manager.cc:1406] Generated new certificate authority record
14:25:49.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.055531 20376 catalog_manager.cc:1540] Loading token signing keys...
14:25:49.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.102486 20376 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be: Generated new TSK 0
14:25:49.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.103480 20376 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:25:49.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.121343 20259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: Neither blocks nor log segments found. Creating new log.
14:25:49.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.123565 20259 log.cc:826] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: Log is configured to *not* fsync() on all Append() calls
14:25:49.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.137880 20259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: No bootstrap required, opened a new log
14:25:49.141 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:49.141 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:49.141 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:49.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:49.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:49.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:49.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:49.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:49.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:49.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:49.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:49.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:49.142 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:49.156 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:49.156 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:49.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.156 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:49.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.157 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.170949 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/logs
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data/info.pb
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.1:0
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.1
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.1
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:49.182 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:49.182 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:49.182 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:49.183 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:49.183 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:49.183 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:49.183 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:49.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:49.183 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:49.183 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:49.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:49.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:49.183 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:49.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114349185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:49.194 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:25:49.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.194599 20259 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:49.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.195398 20259 raft_consensus.cc:385] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:25:49.196 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:25:49.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.195732 20259 raft_consensus.cc:740] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b8fa7d7b2341dd96c18e0a22673623, State: Initialized, Role: FOLLOWER
14:25:49.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.196668 20259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } }
14:25:49.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.204792 20385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.208161 20259 sys_catalog.cc:565] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: configured and running, proceeding with master startup.
14:25:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.208268 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7edbd45703d47b8a690329b7bc289be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b8fa7d7b2341dd96c18e0a22673623" is_pre_election: true
14:25:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.209126 20234 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7edbd45703d47b8a690329b7bc289be in term 0.
14:25:49.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.205442 20385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: This master's current role is: FOLLOWER
14:25:49.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.212039 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7edbd45703d47b8a690329b7bc289be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b8fa7d7b2341dd96c18e0a22673623"
14:25:49.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.212589 20233 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 0 FOLLOWER]: Advancing to term 1
14:25:49.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.220012 20233 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7edbd45703d47b8a690329b7bc289be in term 1.
14:25:49.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.221298 20232 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [term 1 FOLLOWER]: Refusing update from remote peer e7edbd45703d47b8a690329b7bc289be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:25:49.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.230819 20374 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:25:49.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.234858 20213 tablet.cc:2404] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:25:49.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.273265 20391 mvcc.cc:204] Tried to move back new op lower bound from 7287252373074665472 to 7287252372891619328. Current Snapshot: MvccSnapshot[applied={T|T < 7287252373074665472}]
14:25:49.288 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:49.288 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:49.288 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:49.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:49.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:49.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:49.290 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:49.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.307127 20385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7edbd45703d47b8a690329b7bc289be. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:49.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.307833 20385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: This master's current role is: FOLLOWER
14:25:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.309178 20393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:49.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.309829 20393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623 [sys.catalog]: This master's current role is: FOLLOWER
14:25:49.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.312928 20402 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:25:49.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.338 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:49.338 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:49.338 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:49.339 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.339 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.339 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.339 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.339 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.339 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.339 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:49.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.674 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:49.674 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:49.674 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:49.675 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:49.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.676 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:49.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.676 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:49.676 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:49.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114349685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:49.693 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:49.694 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:25:49.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.766803 20384 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:49.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.768007 20374 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e7edbd45703d47b8a690329b7bc289be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce679dc264f34c2b988d0c0bff2338a0" member_type: VOTER last_known_addr { host: "127.19.148.62" port: 34807 } } peers { permanent_uuid: "44b8fa7d7b2341dd96c18e0a22673623" member_type: VOTER last_known_addr { host: "127.19.148.61" port: 37523 } } peers { permanent_uuid: "e7edbd45703d47b8a690329b7bc289be" member_type: VOTER last_known_addr { host: "127.19.148.60" port: 37365 } } }
14:25:49.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.767448 20384 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:49.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.768790 20374 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7edbd45703d47b8a690329b7bc289be [sys.catalog]: This master's current role is: LEADER
14:25:49.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.769429 20384 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:49.770 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:49.770 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:49.771 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:49.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.772 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:49.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.775873 20365 catalog_manager.cc:1295] Loaded cluster ID: 1b5b8c2448b4410b8a488ddc6a807ab3
14:25:49.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.776157 20365 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: loading cluster ID for follower catalog manager: success
14:25:49.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.781404 20365 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: acquiring CA information for follower catalog manager: success
14:25:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.790871 20365 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ce679dc264f34c2b988d0c0bff2338a0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:49.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.828297 20384 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:49.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.829517 20384 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.148.1
14:25:49.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.849 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:49.849 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:49.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:49.850 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.850 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.850 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:49.852 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:49.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:49.852 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:49.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.892935 20384 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.1:0
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data/info.pb
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.1
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.1
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/logs
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:49.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.894621 20384 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:49.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:49.897034 20384 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:49.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.956983 20410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:50.082 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:50.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:50.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:50.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:50.085 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:50.085 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:50.085 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:50.085 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:50.087 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:50.087 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:50.087 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:50.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:50.088 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:50.088 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28639), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [10ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [30ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [40ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [41ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [41ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [123ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [123ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [203ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [203ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [303ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [444ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [742ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [743ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1304ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1963ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5860ms] refreshing cache from master, [5860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5862ms] too many traces: truncated at 100 traces, deferred=Deferred@1211793000(state=PENDING, result=null, callback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154), errback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154)))
14:25:50.089 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:25:50.090 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28639), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [10ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [30ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [40ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [41ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [41ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [123ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [123ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [203ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [203ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [303ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [444ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [742ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [743ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1304ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1963ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5860ms] refreshing cache from master, [5860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5862ms] too many traces: truncated at 100 traces, deferred=Deferred@1211793000(state=PENDING, result=null, callback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154), errback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:50.090 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:25:50.093 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:25:50.096 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28639), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [10ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [30ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [40ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [41ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [41ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [80ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [123ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [123ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [203ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [203ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [303ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [443ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [444ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [742ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [743ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1304ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1963ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5860ms] refreshing cache from master, [5860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5862ms] too many traces: truncated at 100 traces, deferred=Deferred@1211793000(state=PENDING, result=null, callback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154), errback=(continuation of Deferred@846394309 after retry RPC after error@2055399192) -> (continuation of Deferred@926465873 after retry RPC after error@745164512) -> (continuation of Deferred@161705075 after retry RPC after error@1693769848) -> (continuation of Deferred@381950336 after retry RPC after error@1747409142) -> (continuation of Deferred@2054513013 after retry RPC after error@960604515) -> (continuation of Deferred@268419026 after retry RPC after error@1565369907) -> (continuation of Deferred@207751718 after retry RPC after error@945594488) -> (continuation of Deferred@1244633486 after retry RPC after error@2061746886) -> (continuation of Deferred@1716307078 after retry RPC after error@995026775) -> (continuation of Deferred@219937369 after retry RPC after error@1770716366) -> (continuation of Deferred@1768058253 after retry RPC after error@635067305) -> (continuation of Deferred@2009179257 after retry RPC after error@1234393795) -> (continuation of Deferred@862406777 after retry RPC after error@1150769839) -> (continuation of Deferred@1049611304 after retry RPC after error@1838795896) -> (continuation of Deferred@1689543986 after retry RPC after error@445122857) -> (continuation of Deferred@1512466652 after retry RPC after error@2038404588) -> (continuation of Deferred@1042670084 after retry RPC after error@1690199464) -> (continuation of Deferred@230130027 after retry RPC after error@140682692) -> (continuation of Deferred@424039182 after retry RPC after error@239265451) -> (continuation of Deferred@1062179537 after retry RPC after error@572415097) -> (continuation of Deferred@166438167 after retry RPC after error@268791103) -> (continuation of Deferred@1402977524 after retry RPC after error@62050154)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:50.097 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:50.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
14:25:50.098 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:25:50.098 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RUNNING to RESTARTING.
14:25:50.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114350185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:50.193 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:25:50.194 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:25:50.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:50.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:50.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:50.224 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:50.224 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:50.224 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:50.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:50.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:50.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:50.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:50.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:50.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:50.224 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:50.247 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:50.248 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:50.248 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:50.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:50.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:50.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:50.248 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:50.248 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:50.248 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:50.249 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:50.249 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:50.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:50.249 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:50.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:50.327207 20402 catalog_manager.cc:1295] Loaded cluster ID: 1b5b8c2448b4410b8a488ddc6a807ab3
14:25:50.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:50.327677 20402 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: loading cluster ID for follower catalog manager: success
14:25:50.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:50.351900 20402 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: acquiring CA information for follower catalog manager: success
14:25:50.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:50.371143 20402 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 44b8fa7d7b2341dd96c18e0a22673623: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:25:50.400 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:50.401 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:50.401 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:50.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.402 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:50.406 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:50.406 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:50.406 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:50.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:50.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:50.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:50.407 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:50.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:50.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:50.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:50.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:50.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:50.407 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:50.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:50.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:50.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:50.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.458 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:50.627 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114350685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:50.694 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:25:50.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:25:50.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.760 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:50.761 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:50.761 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:50.761 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.761 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.761 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:50.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:50.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.763 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:50.763 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:50.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:50.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:50.826 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:50.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.827 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:50.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:50.896 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:50.897 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:50.897 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:50.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:50.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:50.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:50.897 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:51.027 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:51.027 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:51.027 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:51.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.028 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.028 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:51.062 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:51.062 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:51.063 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:51.063 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.063 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.063 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.063 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.063 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.063 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.064 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.064 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:51.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.146 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:51.146 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:51.146 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:51.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.148 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:51.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114351186 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:51.195 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:25:51.196 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:25:51.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.571 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:51.571 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:51.571 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:51.571 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.571 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.572 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.572 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.572 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.572 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.572 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.572 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.572 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.572 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:51.586 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:51.586 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:51.586 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:51.587 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.587 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.587 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.587 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.587 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.587 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.587 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.587 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:51.606 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RESTARTING to RUNNING.
14:25:51.606 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2c28d6d49adcc0d598680955c9f9304b from Checkpoint 69 @ 1779114320041 for 2c28d6d49adcc0d598680955c9f9304b located at file:/tmp/junit9781152734840635638/checkpoints/2c28d6d49adcc0d598680955c9f9304b/chk-69.
14:25:51.607 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:25:51.607 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
14:25:51.608 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
14:25:51.608 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 8e9538df5a0dfbedb16829666ce7ddc2
14:25:51.609 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:51.609 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:25:51.610 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 8e9538df5a0dfbedb16829666ce7ddc2.
14:25:51.613 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 69 for source Source: KuduSource to checkpoint.
14:25:51.615 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:51.615 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:51.615 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:51.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.616 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:51.626 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:51.626 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:51.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.626 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:51.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:51.627 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
14:25:51.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.627 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
14:25:51.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:51.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:51.627 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:51.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c777b1b
14:25:51.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:51.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:25:51.628 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26743), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [16ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [27ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [45ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [723ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4642ms] too many traces: truncated at 100 traces, deferred=Deferred@191193678(state=PENDING, result=null, callback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166), errback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166)))
14:25:51.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:25:51.629 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:51.629 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26743), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [16ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [27ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [45ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [723ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4642ms] too many traces: truncated at 100 traces, deferred=Deferred@191193678(state=PENDING, result=null, callback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166), errback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:51.630 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
14:25:51.632 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
14:25:51.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26743), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [15ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [16ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [27ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [45ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [243ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [723ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [961ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [962ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4642ms] too many traces: truncated at 100 traces, deferred=Deferred@191193678(state=PENDING, result=null, callback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166), errback=(continuation of Deferred@404837754 after retry RPC after error@41810827) -> (continuation of Deferred@33031959 after retry RPC after error@565146228) -> (continuation of Deferred@867658174 after retry RPC after error@1593535968) -> (continuation of Deferred@528091543 after retry RPC after error@1167914206) -> (continuation of Deferred@1307483978 after retry RPC after error@1216315258) -> (continuation of Deferred@117891411 after retry RPC after error@631164777) -> (continuation of Deferred@473108575 after retry RPC after error@797190156) -> (continuation of Deferred@523782358 after retry RPC after error@1275996639) -> (continuation of Deferred@1220241897 after retry RPC after error@1190263994) -> (continuation of Deferred@458388042 after retry RPC after error@649064494) -> (continuation of Deferred@893919539 after retry RPC after error@2090147596) -> (continuation of Deferred@1952310006 after retry RPC after error@757748435) -> (continuation of Deferred@1495252988 after retry RPC after error@220640940) -> (continuation of Deferred@376946604 after retry RPC after error@1765071739) -> (continuation of Deferred@1307601406 after retry RPC after error@1977296186) -> (continuation of Deferred@1585082098 after retry RPC after error@291150149) -> (continuation of Deferred@1596701961 after retry RPC after error@1945477411) -> (continuation of Deferred@2130005073 after retry RPC after error@1000370811) -> (continuation of Deferred@971064307 after retry RPC after error@1732448597) -> (continuation of Deferred@864050728 after retry RPC after error@193712521) -> (continuation of Deferred@952559056 after retry RPC after error@1206948388) -> (continuation of Deferred@1982916076 after retry RPC after error@602043706) -> (continuation of Deferred@738585843 after retry RPC after error@1864837861) -> (continuation of Deferred@516533608 after retry RPC after error@775045166)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:51.635 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:51.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
14:25:51.637 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
14:25:51.637 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:25:51.637 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:25:51.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@15aaa1a9
14:25:51.642 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:51.649 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.655 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.666 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.667 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.667 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.670 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.675 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.676 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.676 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.676 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114351685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:51.686 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.694 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:25:51.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:25:51.696 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.704 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.704 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.704 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.709 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.710 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:51.711 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:51.711 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:51.711 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.711 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.712 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.712 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:51.718 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.718 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.718 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.718 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.722 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.723 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.723 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.723 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.723 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.730 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.730 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.730 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.731 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.731 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.731 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.731 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:51.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:51.737 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:51.737 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.737 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.737 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.738 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.738 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:51.749 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.749 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.749 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.749 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.750 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.750 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.750 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.750 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.750 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.750 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.750 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.750 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.750 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:51.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:51.767 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:51.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.768 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:51.770 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.770 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.770 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.770 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.770 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.770 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.771 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.786 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:51.786 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:51.786 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:51.786 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.786 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.786 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:51.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:51.788 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.788 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.788 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:51.788 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:51.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:51.849 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.850 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.850 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:51.922 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:51.922 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:51.922 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:51.923 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.923 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.923 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:51.923 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.923 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.923 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:51.923 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.923 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.923 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:51.923 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:51.930 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:51.930 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:51.930 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:51.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.931 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.931 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:51.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:51.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:51.931 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:51.970 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:51.970 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:51.970 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:51.970 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:51.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.971 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:51.971 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.971 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.971 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:51.971 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:52.050 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:52.050 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:52.050 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:52.051 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.051 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.051 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.051 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.051 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.051 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:52.068 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:52.068 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:52.068 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:52.068 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:52.068 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:52.068 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:52.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:52.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:52.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:52.069 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:52.069 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:52.069 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:52.069 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:52.156 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:52.156 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:52.156 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:52.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.157 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:52.185 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114352185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:52.195 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:25:52.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:25:52.198 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:51.344306 20409 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 20384
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:52.411926 20409 kernel_stack_watchdog.cc:198] Thread 20384 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 378ms:
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:49.966573 20411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:52.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:52.420802 20384 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.457s	user 0.273s	sys 0.588s
14:25:52.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:52.421249 20384 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.457s	user 0.273s	sys 0.588s
14:25:52.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:52.422498 20412 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2457 milliseconds
14:25:52.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.423062 20384 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:52.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:52.423120 20413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:52.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.424304 20384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:52.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.426826 20384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:52.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.428275 20384 hybrid_clock.cc:648] HybridClock initialized: now 1779114352428220 us; error 49 us; skew 500 ppm
14:25:52.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.429240 20384 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:52.430 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:52.430 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:52.430 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:52.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:52.431 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.431 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.431 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:52.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:52.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:52.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.436641 20384 webserver.cc:533] Webserver started at http://127.19.148.1:45349/ using document root <none> and password file <none>
14:25:52.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.437676 20384 fs_manager.cc:362] Metadata directory not provided
14:25:52.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.437913 20384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:52.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.438555 20384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:52.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.443851 20384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data/instance:
14:25:52.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:25:52.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:52 on dist-test-slave-1n46"
14:25:52.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.444897 20384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal/instance:
14:25:52.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:25:52.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:52 on dist-test-slave-1n46"
14:25:52.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.453048 20384 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
14:25:52.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.459148 20434 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:52.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.460243 20384 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
14:25:52.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.460510 20384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal
14:25:52.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:25:52.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:52 on dist-test-slave-1n46"
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.460886 20384 fs_report.cc:389] FS layout report
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data/data
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:52.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.514902 20384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:52.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.516384 20384 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:52.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.516841 20384 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:52.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.519711 20384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:52.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.524474 20384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:52.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.524703 20384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:52.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.524961 20384 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:52.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.525152 20384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:52.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114352685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:52.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.698 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:25:52.700 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:25:52.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.743191 20384 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.1:36125
14:25:52.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.743286 20546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.1:36125 every 8 connection(s)
14:25:52.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.746053 20384 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/data/info.pb
14:25:52.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.753705 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20384
14:25:52.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.754382 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-0/wal/instance
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.780277 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/logs
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data/info.pb
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.2:0
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.2
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.2
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:52.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.798954 20549 heartbeater.cc:344] Connected to a master server at 127.19.148.62:34807
14:25:52.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.799484 20549 heartbeater.cc:461] Registering TS with master...
14:25:52.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.801352 20547 heartbeater.cc:344] Connected to a master server at 127.19.148.60:37365
14:25:52.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.801748 20547 heartbeater.cc:461] Registering TS with master...
14:25:52.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.803028 20549 heartbeater.cc:507] Master 127.19.148.62:34807 requested a full tablet report, sending...
14:25:52.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.803208 20547 heartbeater.cc:507] Master 127.19.148.60:37365 requested a full tablet report, sending...
14:25:52.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.806878 20093 ts_manager.cc:194] Registered new tserver with Master: e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:25:52.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.807780 20303 ts_manager.cc:194] Registered new tserver with Master: e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:25:52.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.812630 20548 heartbeater.cc:344] Connected to a master server at 127.19.148.61:37523
14:25:52.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.812947 20548 heartbeater.cc:461] Registering TS with master...
14:25:52.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.813721 20548 heartbeater.cc:507] Master 127.19.148.61:37523 requested a full tablet report, sending...
14:25:52.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.812130 20303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.148.1:52693
14:25:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:52.816764 20224 ts_manager.cc:194] Registered new tserver with Master: e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:25:52.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:52.959 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:52.959 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:52.959 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:52.960 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.960 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.960 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:52.960 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.960 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:52.960 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.960 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.960 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:52.960 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:53.003 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:53.003 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:53.003 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:53.003 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.004 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.132885 20557 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.133284 20557 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.133652 20557 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:53.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.164451 20557 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:53.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.165310 20557 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.148.2
14:25:53.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114353185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:53.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.198 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:53.199 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:53.201589 20557 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.2:0
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data/info.pb
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.2
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.2
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/logs
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:53.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:53.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:53.203140 20557 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:53.204559 20557 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:53.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.217532 20563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:53.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.286 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:53.286 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:53.286 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:53.287 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.287 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.288 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:53.289 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:53.289 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:53.290 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:53.290 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:53.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:53.290 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:53.291 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:53.291 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:53.291 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:53.291 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:53.291 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:53.291 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:53.291 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:53.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.337 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:53.337 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:53.337 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:53.338 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.338 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.338 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.339 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.339 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:53.348 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:53.348 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:53.348 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:53.349 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.349 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.349 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.349 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.349 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.349 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.350 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:53.414 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:53.415 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:53.415 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:53.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.416 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.416 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.416 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.416 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.416 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.416 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.416 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:53.417 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [58ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [59ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [111ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [113ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [166ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [166ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [225ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [228ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [229ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [344ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [344ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [822ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [823ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3320ms] refreshing cache from master, [3320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3941ms] refreshing cache from master, [3941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3942ms] too many traces: truncated at 100 traces, deferred=Deferred@965502249(state=PENDING, result=null, callback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866), errback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866)))
14:25:53.418 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:53.419 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [58ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [59ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [111ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [113ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [166ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [166ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [225ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [228ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [229ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [344ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [344ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [822ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [823ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3320ms] refreshing cache from master, [3320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3941ms] refreshing cache from master, [3941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3942ms] too many traces: truncated at 100 traces, deferred=Deferred@965502249(state=PENDING, result=null, callback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866), errback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:53.419 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
14:25:53.423 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
14:25:53.425 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28517), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [58ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [59ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [111ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [113ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [166ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [166ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [225ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [228ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [229ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [229ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [344ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [344ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [363ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [822ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [823ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [823ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3320ms] refreshing cache from master, [3320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3941ms] refreshing cache from master, [3941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3942ms] too many traces: truncated at 100 traces, deferred=Deferred@965502249(state=PENDING, result=null, callback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866), errback=(continuation of Deferred@61984090 after retry RPC after error@1150627701) -> (continuation of Deferred@1828822652 after retry RPC after error@939396056) -> (continuation of Deferred@984144736 after retry RPC after error@1462482375) -> (continuation of Deferred@909652768 after retry RPC after error@1910460148) -> (continuation of Deferred@231798900 after retry RPC after error@123724164) -> (continuation of Deferred@1888052092 after retry RPC after error@2066365303) -> (continuation of Deferred@1899196222 after retry RPC after error@152626013) -> (continuation of Deferred@842130305 after retry RPC after error@409638707) -> (continuation of Deferred@1917473183 after retry RPC after error@1007044224) -> (continuation of Deferred@26646378 after retry RPC after error@1300843364) -> (continuation of Deferred@1844395491 after retry RPC after error@1666401432) -> (continuation of Deferred@1456190047 after retry RPC after error@1369309577) -> (continuation of Deferred@1166687868 after retry RPC after error@1015338449) -> (continuation of Deferred@936825172 after retry RPC after error@375725166) -> (continuation of Deferred@42510592 after retry RPC after error@406380253) -> (continuation of Deferred@426107135 after retry RPC after error@660412881) -> (continuation of Deferred@1624929427 after retry RPC after error@1045069923) -> (continuation of Deferred@144637261 after retry RPC after error@1203957278) -> (continuation of Deferred@1947169945 after retry RPC after error@506248163) -> (continuation of Deferred@1629964798 after retry RPC after error@835058138) -> (continuation of Deferred@1054996679 after retry RPC after error@1172942683) -> (continuation of Deferred@509240993 after retry RPC after error@13584281) -> (continuation of Deferred@836350087 after retry RPC after error@969032336) -> (continuation of Deferred@1952466023 after retry RPC after error@241772285) -> (continuation of Deferred@1917383231 after retry RPC after error@1505093668) -> (continuation of Deferred@788585481 after retry RPC after error@1746491866)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:53.426 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:53.427 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
14:25:53.427 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
14:25:53.436 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:53.436 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:53.436 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:53.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.437 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.437 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.437 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.437 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.437 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.437 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:53.579 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:53.579 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:53.579 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:53.580 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:53.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:53.581 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.581 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.581 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:53.581 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:53.582 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28676), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [113ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [114ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [114ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [185ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [186ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [265ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1565ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4261ms] refreshing cache from master, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4263ms] too many traces: truncated at 100 traces, deferred=Deferred@1090893196(state=PENDING, result=null, callback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289), errback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289)))
14:25:53.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:53.584 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28676), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [113ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [114ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [114ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [185ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [186ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [265ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1565ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4261ms] refreshing cache from master, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4263ms] too many traces: truncated at 100 traces, deferred=Deferred@1090893196(state=PENDING, result=null, callback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289), errback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:53.585 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
14:25:53.586 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:53.586 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:53.586 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:53.587 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:53.587 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:53.587 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:53.587 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:53.587 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:53.587 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:53.588 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:53.588 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:53.588 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:53.588 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:53.589 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
14:25:53.592 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28676), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [8ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [8ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [25ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [26ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [112ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [113ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [114ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [114ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [123ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [185ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [186ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [186ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [265ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [342ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [601ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1565ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2683ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4261ms] refreshing cache from master, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4263ms] too many traces: truncated at 100 traces, deferred=Deferred@1090893196(state=PENDING, result=null, callback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289), errback=(continuation of Deferred@155370325 after retry RPC after error@896646914) -> (continuation of Deferred@1261975626 after retry RPC after error@662523252) -> (continuation of Deferred@951741093 after retry RPC after error@740127) -> (continuation of Deferred@175888700 after retry RPC after error@1193292778) -> (continuation of Deferred@740591337 after retry RPC after error@1982686145) -> (continuation of Deferred@583788033 after retry RPC after error@1689403089) -> (continuation of Deferred@1823080288 after retry RPC after error@1904720479) -> (continuation of Deferred@201437568 after retry RPC after error@2033209959) -> (continuation of Deferred@1522655454 after retry RPC after error@374930587) -> (continuation of Deferred@391434849 after retry RPC after error@1821120902) -> (continuation of Deferred@958317529 after retry RPC after error@1760779333) -> (continuation of Deferred@1501908192 after retry RPC after error@1439252095) -> (continuation of Deferred@436612884 after retry RPC after error@1759856997) -> (continuation of Deferred@469039829 after retry RPC after error@122815762) -> (continuation of Deferred@738714723 after retry RPC after error@1852522215) -> (continuation of Deferred@1391805357 after retry RPC after error@1167636084) -> (continuation of Deferred@1445951064 after retry RPC after error@1636099708) -> (continuation of Deferred@420751818 after retry RPC after error@423565194) -> (continuation of Deferred@881803075 after retry RPC after error@1920895144) -> (continuation of Deferred@1251779924 after retry RPC after error@738097354) -> (continuation of Deferred@1724264401 after retry RPC after error@1618727017) -> (continuation of Deferred@1340243767 after retry RPC after error@386037289)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:53.595 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:53.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
14:25:53.598 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
14:25:53.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114353685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:53.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.698 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:25:53.699 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:25:53.711 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:53.711 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:53.711 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:53.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.712 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.712 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.712 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.712 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.712 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.713 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:53.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:53.820309 20547 heartbeater.cc:499] Master 127.19.148.60:37365 was elected leader, sending a full tablet report...
14:25:53.827 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:53.827 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:53.828 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:53.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.828 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.828 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.828 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.828 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.828 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.828 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.828 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.828 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:53.830 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:53.830 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:53.830 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:53.831 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.831 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.831 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.832 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:53.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:53.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:53.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:53.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:53.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:53.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.890 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:53.891 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.891 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.891 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:53.891 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:53.928 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:53.928 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:53.928 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:53.929 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:53.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:53.930 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.930 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.930 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:53.930 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:54.123 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:54.123 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:54.123 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:54.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.125 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.125 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.125 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:54.143 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.143 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.144 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.145 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.146 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [78ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1463ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2702ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4941ms] refreshing cache from master, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4942ms] too many traces: truncated at 100 traces, deferred=Deferred@928180153(state=PENDING, result=null, callback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582), errback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582)))
14:25:54.147 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.147 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.147 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.148 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.148 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.148 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.149 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.150 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:54.150 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:54.151 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:54.151 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:54.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:54.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:54.152 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:54.152 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:54.152 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:54.152 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:54.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:54.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:54.152 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:54.148 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [78ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1463ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2702ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4941ms] refreshing cache from master, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4942ms] too many traces: truncated at 100 traces, deferred=Deferred@928180153(state=PENDING, result=null, callback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582), errback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [78ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1463ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2702ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4941ms] refreshing cache from master, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4942ms] too many traces: truncated at 100 traces, deferred=Deferred@928180153(state=PENDING, result=null, callback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582), errback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.190:41547
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:54.163 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.163 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.163 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.163 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.164 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.166 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [78ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1463ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2702ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4941ms] refreshing cache from master, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4942ms] too many traces: truncated at 100 traces, deferred=Deferred@928180153(state=PENDING, result=null, callback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582), errback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [7ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [25ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [78ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1463ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2701ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2702ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4941ms] refreshing cache from master, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4942ms] too many traces: truncated at 100 traces, deferred=Deferred@928180153(state=PENDING, result=null, callback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582), errback=(continuation of Deferred@706926026 after retry RPC after error@265026016) -> (continuation of Deferred@431630478 after retry RPC after error@972385071) -> (continuation of Deferred@96822622 after retry RPC after error@1435601151) -> (continuation of Deferred@497497243 after retry RPC after error@261720083) -> (continuation of Deferred@567862059 after retry RPC after error@2018984351) -> (continuation of Deferred@1550885346 after retry RPC after error@535454575) -> (continuation of Deferred@2043484674 after retry RPC after error@995419933) -> (continuation of Deferred@1660038692 after retry RPC after error@776984590) -> (continuation of Deferred@1069800143 after retry RPC after error@590593573) -> (continuation of Deferred@1354966889 after retry RPC after error@10230487) -> (continuation of Deferred@564702633 after retry RPC after error@525663535) -> (continuation of Deferred@1449486787 after retry RPC after error@919575418) -> (continuation of Deferred@1382989295 after retry RPC after error@1785433864) -> (continuation of Deferred@398313719 after retry RPC after error@1575195953) -> (continuation of Deferred@2051398311 after retry RPC after error@1289750824) -> (continuation of Deferred@904108595 after retry RPC after error@1961413539) -> (continuation of Deferred@539801467 after retry RPC after error@1816744735) -> (continuation of Deferred@1163034279 after retry RPC after error@2010447997) -> (continuation of Deferred@839378579 after retry RPC after error@342919783) -> (continuation of Deferred@1115777288 after retry RPC after error@487088077) -> (continuation of Deferred@280367489 after retry RPC after error@365122) -> (continuation of Deferred@1233482339 after retry RPC after error@372030121) -> (continuation of Deferred@909548532 after retry RPC after error@445483250) -> (continuation of Deferred@2029647786 after retry RPC after error@192148462) -> (continuation of Deferred@152576079 after retry RPC after error@2141512582)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.190:41547
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:25:54.167 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:25:54.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
14:25:54.167 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
14:25:54.168 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:54.168 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
14:25:54.168 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:54.170 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:25:54.170 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
14:25:54.170 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:25:54.172 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
14:25:54.172 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
14:25:54.173 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:25:54.180 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:54.180 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:54.180 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:54.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:54.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:54.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:54.181 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:54.181 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:54.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:54.182 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:54.182 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:54.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:54.182 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:54.183 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.184 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.184 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.185 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.185 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.185 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114354185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:54.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.198 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:25:54.200 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:25:54.203 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.203 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.203 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.204 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.204 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.204 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.205 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.223 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.224 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.224 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.224 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.266 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.266 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.266 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.268 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.303 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.303 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.303 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.304 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.423 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.424 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:54.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:54.456 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:54.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:54.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:54.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:54.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:54.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:54.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:54.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:54.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:54.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:54.457 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:54.458 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29540), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [4ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [54ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [92ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [93ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [94ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [94ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [104ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [124ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [124ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [144ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [166ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [167ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [167ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [245ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [245ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [251ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [251ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [383ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [383ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [384ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [384ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [723ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [723ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [723ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1301ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1303ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1942ms] too many traces: truncated at 100 traces, deferred=Deferred@1283844660(state=PENDING, result=null, callback=(continuation of Deferred@132459054 after retry RPC after error@1276913940) -> (continuation of Deferred@975979352 after retry RPC after error@1494993507) -> (continuation of Deferred@1996566324 after retry RPC after error@1526262857) -> (continuation of Deferred@35017421 after retry RPC after error@98162750) -> (continuation of Deferred@2069835582 after retry RPC after error@1717046968) -> (continuation of Deferred@1458092164 after retry RPC after error@490439247) -> (continuation of Deferred@522151945 after retry RPC after error@966039708) -> (continuation of Deferred@715860914 after retry RPC after error@1808006482) -> (continuation of Deferred@267947779 after retry RPC after error@305505816) -> (continuation of Deferred@1638988119 after retry RPC after error@367894878) -> (continuation of Deferred@1587979383 after retry RPC after error@1637666013) -> (continuation of Deferred@125893624 after retry RPC after error@2141146375) -> (continuation of Deferred@343002015 after retry RPC after error@319555560) -> (continuation of Deferred@324231498 after retry RPC after error@379707730) -> (continuation of Deferred@211221802 after retry RPC after error@2144765975) -> (continuation of Deferred@1997008790 after retry RPC after error@1857366869) -> (continuation of Deferred@1433527300 after retry RPC after error@506218637) -> (continuation of Deferred@1453293441 after retry RPC after error@288823684) -> (continuation of Deferred@1270648418 after retry RPC after error@925425592) -> (continuation of Deferred@451333547 after retry RPC after error@867441738) -> (continuation of Deferred@475286464 after retry RPC after error@1844478701) -> (continuation of Deferred@1104646509 after retry RPC after error@1376949073) -> (continuation of Deferred@1822873752 after retry RPC after error@94947339), errback=(continuation of Deferred@132459054 after retry RPC after error@1276913940) -> (continuation of Deferred@975979352 after retry RPC after error@1494993507) -> (continuation of Deferred@1996566324 after retry RPC after error@1526262857) -> (continuation of Deferred@35017421 after retry RPC after error@98162750) -> (continuation of Deferred@2069835582 after retry RPC after error@1717046968) -> (continuation of Deferred@1458092164 after retry RPC after error@490439247) -> (continuation of Deferred@522151945 after retry RPC after error@966039708) -> (continuation of Deferred@715860914 after retry RPC after error@1808006482) -> (continuation of Deferred@267947779 after retry RPC after error@305505816) -> (continuation of Deferred@1638988119 after retry RPC after error@367894878) -> (continuation of Deferred@1587979383 after retry RPC after error@1637666013) -> (continuation of Deferred@125893624 after retry RPC after error@2141146375) -> (continuation of Deferred@343002015 after retry RPC after error@319555560) -> (continuation of Deferred@324231498 after retry RPC after error@379707730) -> (continuation of Deferred@211221802 after retry RPC after error@2144765975) -> (continuation of Deferred@1997008790 after retry RPC after error@1857366869) -> (continuation of Deferred@1433527300 after retry RPC after error@506218637) -> (continuation of Deferred@1453293441 after retry RPC after error@288823684) -> (continuation of Deferred@1270648418 after retry RPC after error@925425592) -> (continuation of Deferred@451333547 after retry RPC after error@867441738) -> (continuation of Deferred@475286464 after retry RPC after error@1844478701) -> (continuation of Deferred@1104646509 after retry RPC after error@1376949073) -> (continuation of Deferred@1822873752 after retry RPC after error@94947339)))
14:25:54.462 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.463 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.463 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.463 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.463 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.463 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.463 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.510 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:54.510 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:54.511 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:54.511 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:54.511 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:54.511 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:54.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:54.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:54.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:54.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:54.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:54.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:54.514 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:54.543 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:54.544 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:54.544 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:54.544 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.544 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.544 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:54.544 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.544 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.544 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:54.545 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:54.545 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:54.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:53.223057 20564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:54.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:54.553485 20566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:54.557148 20565 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1332 milliseconds
14:25:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:54.558880 20557 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.336s	user 0.448s	sys 0.867s
14:25:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:54.559212 20557 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.337s	user 0.448s	sys 0.867s
14:25:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.559494 20557 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:54.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.560909 20557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:54.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.563566 20557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:54.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.565033 20557 hybrid_clock.cc:648] HybridClock initialized: now 1779114354564999 us; error 32 us; skew 500 ppm
14:25:54.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.566051 20557 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.574095 20557 webserver.cc:533] Webserver started at http://127.19.148.2:33611/ using document root <none> and password file <none>
14:25:54.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.575287 20557 fs_manager.cc:362] Metadata directory not provided
14:25:54.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.575528 20557 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:54.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.576032 20557 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:54.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.582346 20557 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data/instance:
14:25:54.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6af07db694a34546869fea4ba492b323"
14:25:54.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:54 on dist-test-slave-1n46"
14:25:54.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.583714 20557 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal/instance:
14:25:54.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6af07db694a34546869fea4ba492b323"
14:25:54.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:54 on dist-test-slave-1n46"
14:25:54.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.592622 20557 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.005s
14:25:54.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.599613 20577 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:54.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.600912 20557 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
14:25:54.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.601208 20557 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal
14:25:54.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6af07db694a34546869fea4ba492b323"
14:25:54.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:54 on dist-test-slave-1n46"
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.601570 20557 fs_report.cc:389] FS layout report
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data/data
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:54.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:54.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114354685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:54.693 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:25:54.693 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:25:54.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.711393 20557 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:54.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.713001 20557 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:54.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.713423 20557 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:54.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.716125 20557 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:54.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.720625 20557 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:54.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.720808 20557 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:54.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.721005 20557 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:54.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.721130 20557 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:54.755 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:54.755 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:54.755 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:54.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:54.756 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.756 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.756 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:54.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:54.757 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:54.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.879835 20557 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.2:42473
14:25:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.879935 20689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.2:42473 every 8 connection(s)
14:25:54.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.882664 20557 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/data/info.pb
14:25:54.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.892258 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20557
14:25:54.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.892822 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-1/wal/instance
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.918045 20048 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/logs
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data/info.pb
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:54.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.3:0
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.3
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.3
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:54.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:25:54.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.948313 20690 heartbeater.cc:344] Connected to a master server at 127.19.148.60:37365
14:25:54.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.948545 20691 heartbeater.cc:344] Connected to a master server at 127.19.148.61:37523
14:25:54.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.948793 20690 heartbeater.cc:461] Registering TS with master...
14:25:54.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.949013 20691 heartbeater.cc:461] Registering TS with master...
14:25:54.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.950488 20691 heartbeater.cc:507] Master 127.19.148.61:37523 requested a full tablet report, sending...
14:25:54.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.951925 20690 heartbeater.cc:507] Master 127.19.148.60:37365 requested a full tablet report, sending...
14:25:54.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.953771 20224 ts_manager.cc:194] Registered new tserver with Master: 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:25:54.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.954210 20303 ts_manager.cc:194] Registered new tserver with Master: 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:25:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.954960 20692 heartbeater.cc:344] Connected to a master server at 127.19.148.62:34807
14:25:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.955283 20692 heartbeater.cc:461] Registering TS with master...
14:25:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.955963 20303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.148.2:41279
14:25:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.956123 20692 heartbeater.cc:507] Master 127.19.148.62:34807 requested a full tablet report, sending...
14:25:54.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:54.958844 20093 ts_manager.cc:194] Registered new tserver with Master: 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:25:55.003 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:55.004 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:55.004 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:55.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:55.004 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:55.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:55.004 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:55.004 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:55.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:55.004 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:55.004 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:55.004 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:55.004 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:55.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114355185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:55.193 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:25:55.193 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:25:55.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.257727 20700 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:55.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.258574 20700 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:55.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.259281 20700 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:55.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.291985 20700 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:55.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.292712 20700 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.148.3
14:25:55.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:55.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:55.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:55.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.316 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.316 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.316 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.316 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.316 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:55.327756 20700 tablet_server_runner.cc:78] Tablet server non-default flags:
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.148.20:46431
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.148.3:0
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data/info.pb
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.148.3
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.148.62:34807,127.19.148.61:37523,127.19.148.60:37365
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.148.3
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/logs
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:55.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:55.328990 20700 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:55.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:55.330494 20700 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:55.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.343191 20706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:55.666 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:55.667 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:55.667 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:55.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.668 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.668 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.668 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:55.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114355686 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:55.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.700 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:25:55.702 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:25:55.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:55.936 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:55.936 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:55.936 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:55.937 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.937 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.937 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:55.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:55.937 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.937 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:55.937 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:55.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:55.960603 20690 heartbeater.cc:499] Master 127.19.148.60:37365 was elected leader, sending a full tablet report...
14:25:55.987 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:55.988 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:55.988 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:55.988 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.988 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.988 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:55.989 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.989 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:55.989 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.989 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.989 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:55.989 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:56.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:56.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:56.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:56.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.051 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.051 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.051 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.051 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:56.183 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.183 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.183 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.185 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.185 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114356185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:56.187 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:56.187 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:56.188 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:56.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.188 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.189 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.189 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:56.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.201 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
14:25:56.202 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:25:56.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.351 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:56.351 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:56.351 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:56.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.353 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.353 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.353 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:56.430 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:25:56.431 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:25:56.432 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
14:25:56.432 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:25:56.435 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
14:25:56.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
14:25:56.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:25:56.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
14:25:56.437 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
14:25:56.437 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:25:56.437 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
14:25:56.437 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:25:56.439 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:25:56.440 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:25:56.441 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:25:56.441 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:25:56.441 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
14:25:56.441 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:25:56.444 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
14:25:56.445 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:25:56.445 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
14:25:56.445 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:25:56.450 [INFO - Thread-54] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:25:56.451 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:25:56.451 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:25:56.451 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:25:56.451 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:25:56.451 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:25:56.452 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:25:56.453 [INFO - Thread-54] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:25:56.453 [INFO - Thread-54] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:25:56.455 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
14:25:56.455 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
14:25:56.457 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@443f634a
14:25:56.457 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:56.457 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:56.458 [DEBUG - Thread-54] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:56.458 [INFO - Thread-54] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:25:56.459 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:25:56.459 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:25:56.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f6bc258
14:25:56.464 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:25:56.466 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
14:25:56.466 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
14:25:56.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:25:56.469 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:56.469 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:56.469 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:56.469 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:25:56.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61864f39
14:25:56.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:56.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:56.471 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:25:56.471 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:25:56.473 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:56.476 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@36643c6c
14:25:56.477 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
14:25:56.476 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:25:56.478 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:25:56.478 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
14:25:56.479 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3342ef69
14:25:56.479 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:56.479 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:56.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:25:56.495 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:25:56.497 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:56.502 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1391bc26
14:25:56.503 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.508 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:56.509 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:56.509 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:56.509 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:56.509 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.510 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.511 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:56.510 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.511 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.511 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:56.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.511 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.511 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:56.511 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:56.515 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
14:25:56.515 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
14:25:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d7ab3b3
14:25:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:25:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:25:56.522 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:25:56.522 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:25:56.526 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@51cbccd9
14:25:56.538 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:56.539 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.551 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.553 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.553 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.553 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.558 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.567 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.567 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.570 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.576 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.577 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.577 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.580 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.584 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.584 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.589 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.595 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.599 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.600 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.600 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.600 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.601 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.602 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.602 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.603 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.603 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.603 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.603 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.604 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.604 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.610 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.607 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.620 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.626 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.626 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.629 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.630 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.637 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.639 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.642 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.642 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.646 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.646 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.646 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.646 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.652 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.653 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.653 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.653 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.657 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.659 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.664 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.664 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.664 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.664 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.669 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.670 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.673 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.679 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.680 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.683 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.684 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.684 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.684 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.684 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114356685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:56.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.705 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
14:25:56.706 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:25:56.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.714 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.718 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.718 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.718 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.718 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.719 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.720 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.720 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:56.721 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:56.721 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:56.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:56.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:56.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:56.721 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:56.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:56.721 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:56.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:56.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:56.722 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:56.722 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:56.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.722 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.723 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.723 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.723 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.723 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.724 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.724 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.724 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.724 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.725 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.726 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.726 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.727 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.728 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.729 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.729 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.729 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.729 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.729 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.731 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.731 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.731 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.731 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.732 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.732 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.733 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.733 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.733 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.733 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.734 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.734 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.734 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.734 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.735 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.740 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.740 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.740 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.741 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.742 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.742 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.742 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.743 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.743 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.743 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.743 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.743 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.743 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.743 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.743 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.743 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.744 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.744 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.744 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.744 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.745 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.746 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.746 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.746 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.746 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.747 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.747 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.747 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.747 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.747 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.761 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.761 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.761 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.761 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.761 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.761 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.761 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.763 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.764 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.764 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.764 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.764 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.764 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.764 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.765 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.766 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.767 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.767 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.767 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.767 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.767 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.767 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.767 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.768 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.768 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.768 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.768 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.768 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.769 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.769 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.773 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.774 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.774 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.774 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.779 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.779 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.780 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.780 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.780 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.780 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.781 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.781 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.781 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.781 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.784 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.784 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.784 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.784 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.784 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.784 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.785 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.785 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.785 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.785 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.785 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.785 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.798 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.799 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.800 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.800 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.801 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.801 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.801 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.866 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.866 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.866 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.867 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.867 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.868 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.868 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.868 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.868 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.868 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:56.868 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:56.868 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:56.869 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.869 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.869 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.870 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.873 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.873 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.873 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.873 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.873 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:56.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:56.873 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:56.874 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:56.874 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:56.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:56.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:56.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:56.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:56.874 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:56.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.875 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.875 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.875 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.875 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.875 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.876 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.878 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.878 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.878 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.878 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.879 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:56.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.879 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.879 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:56.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:56.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:56.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:56.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:56.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:56.887 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:56.888 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:56.888 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:56.888 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:56.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.888 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.889 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.889 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.889 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.889 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:56.890 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.890 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.890 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.891 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.892 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.899 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.899 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.900 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.900 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.900 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.900 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.901 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.920 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.920 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.920 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.920 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.921 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.921 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.921 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.921 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.921 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.921 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.931 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.931 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.931 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.931 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.932 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.932 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.932 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.964 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.964 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.964 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.964 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.964 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.964 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.965 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.965 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.965 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.965 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.982 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:56.983 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:56.983 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:56.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:56.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:56.983 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:56.984 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:56.991 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:56.991 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:56.991 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:56.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.991 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:56.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:56.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.992 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:56.992 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:56.999 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.000 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.000 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.000 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.001 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.001 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.001 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.007 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:57.007 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:57.007 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:57.008 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.008 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.008 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.008 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.008 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.008 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:57.019 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.020 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.020 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.021 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.040 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.040 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.040 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.041 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.041 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.041 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.042 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.042 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.042 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.066 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:57.067 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:57.067 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:57.067 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.068 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.068 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.068 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.068 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:56.748297 20705 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 20700
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:57.074163 20705 kernel_stack_watchdog.cc:198] Thread 20700 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:25:57.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:25:57.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:55.343765 20707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:57.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:57.076249 20700 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.733s	user 0.625s	sys 1.020s
14:25:57.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:57.076567 20709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:57.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:57.076944 20700 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.733s	user 0.625s	sys 1.020s
14:25:57.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:57.081931 20708 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1737 milliseconds
14:25:57.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.081933 20700 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:57.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.083235 20700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:57.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.085570 20700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:57.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.087054 20700 hybrid_clock.cc:648] HybridClock initialized: now 1779114357087018 us; error 34 us; skew 500 ppm
14:25:57.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.087905 20700 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:57.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.092 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.092 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.092 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.092 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.095021 20700 webserver.cc:533] Webserver started at http://127.19.148.3:37457/ using document root <none> and password file <none>
14:25:57.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.096043 20700 fs_manager.cc:362] Metadata directory not provided
14:25:57.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.096367 20700 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:57.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.096840 20700 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:57.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.101764 20700 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data/instance:
14:25:57.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "931d00931ee34b05bad4b01eeef0558e"
14:25:57.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:57 on dist-test-slave-1n46"
14:25:57.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.102972 20700 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal/instance:
14:25:57.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "931d00931ee34b05bad4b01eeef0558e"
14:25:57.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:57 on dist-test-slave-1n46"
14:25:57.130 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.130 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.131 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.111915 20700 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.008s
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.118412 20770 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.119596 20700 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.119926 20700 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "931d00931ee34b05bad4b01eeef0558e"
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:57 on dist-test-slave-1n46"
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.120267 20700 fs_report.cc:389] FS layout report
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data/data
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:57.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.134 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.134 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.134 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.134 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.134 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.134 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.134 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.144 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.144 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.144 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.145 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.145 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.145 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.145 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.180569 20700 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:57.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.182252 20700 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:57.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.182754 20700 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:57.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114357185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:57.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.186229 20700 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:25:57.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:57.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:57.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:57.187 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.187 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.187 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.188 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.192061 20700 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:25:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.192328 20700 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:25:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.192667 20700 ts_tablet_manager.cc:616] Registered 0 tablets
14:25:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.192814 20700 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:25:57.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.196 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:25:57.200 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:25:57.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.224 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.224 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.224 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.225 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.247 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:57.247 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:57.247 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:57.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:57.248 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.248 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.248 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:57.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:57.249 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:57.259 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.259 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.259 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.260 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.260 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.260 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.310 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:57.310 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:57.311 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:57.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:57.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:57.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:57.311 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:57.311 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:57.311 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:57.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:57.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:57.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:57.312 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:57.320 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.320 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.320 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.321 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.321 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.321 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.321 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.343484 20700 rpc_server.cc:307] RPC server started. Bound to: 127.19.148.3:33363
14:25:57.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.343601 20882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.148.3:33363 every 8 connection(s)
14:25:57.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.346053 20700 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/data/info.pb
14:25:57.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.351701 20048 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20700
14:25:57.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.352240 20048 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster14343246645307096299/ts-2/wal/instance
14:25:57.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.394711 20884 heartbeater.cc:344] Connected to a master server at 127.19.148.61:37523
14:25:57.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.395231 20884 heartbeater.cc:461] Registering TS with master...
14:25:57.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.395675 20883 heartbeater.cc:344] Connected to a master server at 127.19.148.60:37365
14:25:57.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.396107 20883 heartbeater.cc:461] Registering TS with master...
14:25:57.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.396667 20884 heartbeater.cc:507] Master 127.19.148.61:37523 requested a full tablet report, sending...
14:25:57.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.397074 20883 heartbeater.cc:507] Master 127.19.148.60:37365 requested a full tablet report, sending...
14:25:57.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.399326 20224 ts_manager.cc:194] Registered new tserver with Master: 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:25:57.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.399307 20303 ts_manager.cc:194] Registered new tserver with Master: 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:25:57.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.400862 20303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.148.3:50731
14:25:57.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.401594 20885 heartbeater.cc:344] Connected to a master server at 127.19.148.62:34807
14:25:57.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.401921 20885 heartbeater.cc:461] Registering TS with master...
14:25:57.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.402792 20885 heartbeater.cc:507] Master 127.19.148.62:34807 requested a full tablet report, sending...
14:25:57.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.405126 20093 ts_manager.cc:194] Registered new tserver with Master: 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:25:57.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:57.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:57.408 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:57.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:57.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:57.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:57.408 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:57.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:57.408 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:57.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:57.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:57.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:57.409 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:57.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.412873 20048 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:25:57.424 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:57.424 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:25:57.425 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.148.62"
      port: 34807
    }
    bound_http_address {
      host: "127.19.148.62"
      port: 37311
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.148.61"
      port: 37523
    }
    bound_http_address {
      host: "127.19.148.61"
      port: 39365
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.148.60"
      port: 37365
    }
    bound_http_address {
      host: "127.19.148.60"
      port: 38933
    }
  }
}

14:25:57.425 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:25:57.426 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.148.1"
      port: 36125
    }
    bound_http_address {
      host: "127.19.148.1"
      port: 45349
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.148.2"
      port: 42473
    }
    bound_http_address {
      host: "127.19.148.2"
      port: 33611
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.148.3"
      port: 33363
    }
    bound_http_address {
      host: "127.19.148.3"
      port: 37457
    }
  }
}

14:25:57.426 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:25:57.428 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:25:57.428 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:25:57.428 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:25:57.428 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:25:57.428 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:25:57.433 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:25:57.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:57.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:57.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:57.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.552 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.552 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.552 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.552 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.552 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:57.629 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:25:57.630 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:25:57.630 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:25:57.630 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:57.630 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:57.630 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:25:57.631 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:57.631 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:57.631 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:25:57.631 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:57.631 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:57.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:25:57.631 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:25:57.651 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.651 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.651 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.652 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114357685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:57.693 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:57.694 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:25:57.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.720 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.720 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.720 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.721 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.777 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:25:57.777 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:25:57.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.780841 20893 mini_oidc.cc:150] Starting JWKS server
14:25:57.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.784054 20893 webserver.cc:533] Webserver started at http://127.0.0.1:36323/ using document root <none> and password file <none>
14:25:57.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.784487 20893 mini_oidc.cc:186] Starting OIDC Discovery server
14:25:57.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.786172 20893 webserver.cc:533] Webserver started at http://127.0.0.1:38953/ using document root <none> and password file <none>
14:25:57.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:25:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:25:57Z Disabled control of system clock
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:57.846725 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/logs
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data/info.pb
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.126:39327
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.126
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:57.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json with env {}
14:25:57.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:57.920 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:57.921 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:57.921 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:57.921 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.921 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.921 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:57.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:57.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:57.922 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:57.946 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:57.946 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:57.947 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:57.947 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.947 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.947 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:57.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:57.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:57.947 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:58.020 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.020 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.020 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.020 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.021 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.044 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.044 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.044 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.045 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.176 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:58.176 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:58.177 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:58.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.177 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.177 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.177 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:58.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114358185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:58.193 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:25:58.193 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:25:58.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.193610 20905 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:25:58.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.194432 20905 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:25:58.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.195086 20905 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:25:58.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.231541 20905 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:25:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.231835 20905 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:25:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.232071 20905 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:25:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.232270 20905 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:25:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.232463 20905 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:25:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.232623 20905 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36323/jwks.json
14:25:58.251 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.251 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.251 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.251 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.251 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.251 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.252 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.260 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.260 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.260 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.260 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.260 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.260 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:58.271836 20905 master_runner.cc:387] Master server non-default flags:
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.126:39327
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data/info.pb
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.126
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/logs
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:25:58.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:25:58.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:58.273155 20905 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:25:58.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:58.274677 20905 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:25:58.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.285264 20911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:58.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.395 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:58.395 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:58.395 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:58.396 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.396 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.396 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.397 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:58.405383 20883 heartbeater.cc:499] Master 127.19.148.60:37365 was elected leader, sending a full tablet report...
14:25:58.480 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:25:58.481 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:25:58.481 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:25:58.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:58.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:58.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:25:58.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:58.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:58.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:25:58.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:58.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:58.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:25:58.482 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:25:58.620 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.620 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.621 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.621 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.623 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.623 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:58.623 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:58.624 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:58.624 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.624 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.624 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:58.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.625 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:58.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:58.625 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:58.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114358685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:58.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.696 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:25:58.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:25:58.711 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:25:58.711 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:25:58.711 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:25:58.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:58.711 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:58.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:58.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:58.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:25:58.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:25:58.711 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:58.711 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:58.712 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:25:58.712 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:25:58.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:25:58.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:25:58.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:25:58.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:58.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:58.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:58.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:58.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:25:58.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:25:58.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:58.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:58.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:25:58.807 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:25:58.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.843 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:58.843 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:58.843 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:58.843 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.843 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.844 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.844 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.844 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.844 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.844 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.844 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.844 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:58.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:58.908 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:58.909 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:58.909 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:58.909 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.909 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.909 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:58.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:58.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:58.910 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:59.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114359185 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:59.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.197 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:25:59.197 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:25:59.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.267 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:59.268 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:59.268 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:59.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.268 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.269 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.269 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:59.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.420 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:25:59.420 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:25:59.420 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:25:59.420 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:59.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:59.420 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:25:59.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:59.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:59.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:25:59.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:59.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:59.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:25:59.421 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:25:59.495 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:59.495 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:59.495 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:59.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.497 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.497 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.497 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:59.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:58.287565 20912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:59.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.593216 20914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:25:59.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.596925 20913 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1308 milliseconds
14:25:59.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.597018 20905 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:25:59.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.598394 20905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:25:59.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.601310 20905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:25:59.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.602741 20905 hybrid_clock.cc:648] HybridClock initialized: now 1779114359602684 us; error 53 us; skew 500 ppm
14:25:59.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.603686 20905 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:25:59.607 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:25:59.608 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:25:59.608 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:25:59.608 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.608 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.608 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:25:59.609 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.609 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.609 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:25:59.609 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.609 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:25:59.609 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:25:59.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.613628 20905 webserver.cc:533] Webserver started at http://127.20.103.126:33015/ using document root <none> and password file <none>
14:25:59.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.614892 20905 fs_manager.cc:362] Metadata directory not provided
14:25:59.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.615186 20905 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:25:59.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.615753 20905 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:25:59.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.621806 20905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data/instance:
14:25:59.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffcb4321dac944eea2b2ec381b7ba352"
14:25:59.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:59 on dist-test-slave-1n46"
14:25:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.623330 20905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal/instance:
14:25:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffcb4321dac944eea2b2ec381b7ba352"
14:25:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:59 on dist-test-slave-1n46"
14:25:59.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.632254 20905 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
14:25:59.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.639151 20921 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:25:59.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.640265 20905 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:25:59.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.640592 20905 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal
14:25:59.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffcb4321dac944eea2b2ec381b7ba352"
14:25:59.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:25:59 on dist-test-slave-1n46"
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.640942 20905 fs_report.cc:389] FS layout report
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data/data
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:25:59.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:25:59.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114359685 for job 01c353b3dfaac48d363fa91db2a11301.
14:25:59.692 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:25:59.693 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:25:59.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.697587 20905 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:25:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.699092 20905 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:25:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.699532 20905 kserver.cc:163] Server-wide thread pool size limit: 3276
14:25:59.720 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.763 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:25:59.763 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:25:59.763 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:25:59.763 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.763 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:25:59.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:25:59.764 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.764 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.764 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:25:59.764 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:25:59.766 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:25:59.766 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:25:59.766 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:25:59.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:59.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:59.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:25:59.766 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:59.766 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:59.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:25:59.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:59.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:59.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:25:59.767 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:25:59.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.788305 20905 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.126:39327
14:25:59.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.788437 20973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.126:39327 every 8 connection(s)
14:25:59.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.791034 20905 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/data/info.pb
14:25:59.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.796144 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20905
14:25:59.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.796619 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-0/wal/instance
14:25:59.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.798259 20974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.801717 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/logs
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data/info.pb
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.125:34309
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.125
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:25:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:25:59.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:25:59.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json with env {}
14:25:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.813195 20974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } has no permanent_uuid. Determining permanent_uuid...
14:25:59.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.839015 20974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
14:25:59.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.841488 20924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:25:59.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.845749 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:25:59.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:25:59.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.895164 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 1
14:25:59.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.898820 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:25:59.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:25:59.967253 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 2
14:25:59.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:25:59.972319 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:26:00.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.063719 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 3
14:26:00.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.067826 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:26:00.080 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:00.080 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:00.080 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:00.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.081 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:00.088 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:00.089 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:00.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.089 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.089 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.089 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.089 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.089 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:00.089 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.089 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.090 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.090 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:00.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.135233 20976 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:00.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.135846 20976 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:00.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.136409 20976 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:00.140 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:00.140 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:00.140 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:00.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:00.141 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:00.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:00.141 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:00.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:00.141 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:00.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:00.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:00.141 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:00.141 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:00.170 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:00.170 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:00.170 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:00.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.171 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.171 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:00.171 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.171 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.171 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:00.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:00.171 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:00.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.172199 20976 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:00.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.172549 20976 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:00.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.172894 20976 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:00.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.173197 20976 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:00.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.173493 20976 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:00.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.173724 20976 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36323/jwks.json
14:26:00.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114360186 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:00.193 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:26:00.194 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:26:00.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.211192 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 4
14:26:00.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.214403 20976 master_runner.cc:387] Master server non-default flags:
14:26:00.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.125:34309
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data/info.pb
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.125
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/logs
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:00.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:00.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:00.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.215297 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:26:00.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.216209 20976 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:00.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.218220 20976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:00.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.229558 20985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:00.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.506 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:00.507 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:00.507 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:00.507 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:00.507 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:00.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:00.507 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:00.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:00.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:00.508 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:00.508 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:00.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:00.508 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:00.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:00.514714 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 5
14:26:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.521080 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:26:00.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:00.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:00.551 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:00.552 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.552 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.552 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.552 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.552 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.552 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.553 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:00.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114360685 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:00.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.696 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:00.697 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:26:00.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.729 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:00.729 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:00.729 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:00.729 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.729 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.729 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:00.729 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.729 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:00.730 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.730 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.730 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:00.730 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:00.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:00.949 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:00.950 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:00.950 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:00.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:00.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:00.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:00.951 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:00.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:00.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:00.952 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:00.952 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:00.952 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:00.952 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:01.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.068691 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 6
14:26:01.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.078378 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.125:34309: Network error: Client connection negotiation failed: client connection to 127.20.103.125:34309: connect: Connection refused (error 111)
14:26:01.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114361185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:01.194 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:01.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.195 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:26:01.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.446 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:01.447 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:01.447 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:01.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.447 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.448 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.448 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:00.232364 20986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:01.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.543155 20988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.545260 20987 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1309 milliseconds
14:26:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.545351 20976 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.546581 20976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:01.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.549713 20976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.551086 20976 hybrid_clock.cc:648] HybridClock initialized: now 1779114361551036 us; error 69 us; skew 500 ppm
14:26:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.551882 20976 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:01.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.558715 20976 webserver.cc:533] Webserver started at http://127.20.103.125:34285/ using document root <none> and password file <none>
14:26:01.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.559947 20976 fs_manager.cc:362] Metadata directory not provided
14:26:01.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.560278 20976 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:01.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.560634 20976 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:01.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.565125 20976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data/instance:
14:26:01.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed85f0c585847a8aed1cb4ba377d63e"
14:26:01.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:01 on dist-test-slave-1n46"
14:26:01.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.566167 20976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal/instance:
14:26:01.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed85f0c585847a8aed1cb4ba377d63e"
14:26:01.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:01 on dist-test-slave-1n46"
14:26:01.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.573923 20976 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:26:01.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.580587 20997 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.581904 20976 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
14:26:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.582331 20976 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal
14:26:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed85f0c585847a8aed1cb4ba377d63e"
14:26:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:01 on dist-test-slave-1n46"
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.582794 20976 fs_report.cc:389] FS layout report
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data/data
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:01.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:01.590 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:01.591 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:01.591 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:01.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:01.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:01.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:01.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:01.591 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:01.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:01.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:01.591 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:01.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:01.591 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:01.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.637036 20976 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.638656 20976 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.639029 20976 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:01.668 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:01.669 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:01.669 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:01.669 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:01.669 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:01.669 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:01.669 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:01.669 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:01.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:01.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:01.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:01.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:01.670 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:01.683 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:01.683 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:01.683 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:01.684 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.684 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.684 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.684 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.684 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.684 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.684 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.684 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:01.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114361685 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:01.687 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:01.687 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:01.687 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:01.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:01.693 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:26:01.693 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:26:01.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.719 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:01.720 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:01.720 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:01.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.721 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.723191 20976 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.125:34309
14:26:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.723312 21048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.125:34309 every 8 connection(s)
14:26:01.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.725857 20976 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/data/info.pb
14:26:01.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.728833 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 20976
14:26:01.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.729231 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-1/wal/instance
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.732101 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/logs
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data/info.pb
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:01.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.124:41795
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.124
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json with env {}
14:26:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.732934 21049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:01.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.749460 21049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } has no permanent_uuid. Determining permanent_uuid...
14:26:01.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.777719 21049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
14:26:01.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.795441 21049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } has no permanent_uuid. Determining permanent_uuid...
14:26:01.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.799033 21001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:01.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.804960 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:01.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.854516 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 1
14:26:01.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:01.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.859539 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:01.860 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:01.860 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:01.860 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:01.861 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.861 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.861 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.861 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.861 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.861 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:01.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:01.861 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:01.861 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:01.927961 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 2
14:26:01.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:01.933533 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:01.949 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:01.949 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:01.949 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:01.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.950 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.950 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:01.950 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.950 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:01.950 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.950 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.950 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:01.950 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:02.020 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:02.020 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:02.020 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:02.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:02.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:02.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:02.020 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:02.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:02.020 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:02.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:02.020 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:02.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:02.020 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:02.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.025059 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 3
14:26:02.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.028790 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.056 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:02.057 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:02.057 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:02.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.057 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.075420 21051 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:02.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.076099 21051 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:02.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.076514 21051 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:02.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.113585 21051 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.113945 21051 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.114224 21051 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.114415 21051 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.114651 21051 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:02.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.114934 21051 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36323/jwks.json
14:26:02.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.138957 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } attempt: 7
14:26:02.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.151677 20974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } has no permanent_uuid. Determining permanent_uuid...
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.156920 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.157584 21051 master_runner.cc:387] Master server non-default flags:
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal
14:26:02.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.124:41795
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36323/jwks.json
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data/info.pb
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.124
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/logs
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:02.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.158892 21051 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:02.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.160403 21051 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:02.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.171712 21064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:02.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.172171 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 4
14:26:02.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.177950 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.185 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114362185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:02.193 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:02.194 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:26:02.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.215270 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 1
14:26:02.220 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.224256 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.246 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:02.247 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:02.247 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:02.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:02.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:02.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:02.249 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:02.249 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:02.249 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:02.250 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:02.250 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:02.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:02.250 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:02.251 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:02.251 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:02.251 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:02.252 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:02.252 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:02.252 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:02.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:02.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:02.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:02.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:02.253 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:02.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:02.253 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:02.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.305801 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 2
14:26:02.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.315325 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.400889 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 3
14:26:02.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.409909 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.477416 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 5
14:26:02.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.486644 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.550652 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 4
14:26:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.566846 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114362685 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:02.697 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.701 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:26:02.703 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:26:02.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:02.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:02.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:02.752 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:02.752 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:02.752 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:02.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:02.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:02.753 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:02.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:02.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:02.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:02.754 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:02.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:02.850445 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 5
14:26:02.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:02.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.864379 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:02.962 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:02.963 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:02.963 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:02.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:02.963 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:02.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:02.964 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:03.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.034215 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 6
14:26:03.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.061932 21049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:03.168 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:03.168 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:03.168 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:03.169 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.170 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.170 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.170 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.170 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.170 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.170 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.171 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:03.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114363185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:03.197 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.203 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:26:03.207 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:26:03.209 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:03.210 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:03.210 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:03.210 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:03.210 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:03.210 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:03.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:03.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:03.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:03.211 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:03.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:03.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:03.212 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:03.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:03.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:03.315 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:03.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.315 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.316 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.316 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.316 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.316 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.316 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.316 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:03.326 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:03.326 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:03.326 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:03.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.327 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.327 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.327 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.327 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:03.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.417014 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 6
14:26:03.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.456136 20974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.103.124:41795: Network error: Client connection negotiation failed: client connection to 127.20.103.124:41795: connect: Connection refused (error 111)
14:26:03.471 [DEBUG - pool-308-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [5ms] received response from server master-127.17.128.60:42293: OK, deferred=null) with no deferred attached!
14:26:03.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114363685 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:03.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.703 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:26:03.709 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:26:03.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.580302 21063 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 21051
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.725664 21063 kernel_stack_watchdog.cc:198] Thread 21051 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 402ms:
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:26:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.726495 21051 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.553s	user 0.500s	sys 1.039s
14:26:03.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.726846 21051 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.554s	user 0.500s	sys 1.039s
14:26:03.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:02.173586 21065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:03.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.728543 21067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:03.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.732550 21051 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:03.733018 21066 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1551 milliseconds
14:26:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.734467 21051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:03.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.737527 21051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:03.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.739007 21051 hybrid_clock.cc:648] HybridClock initialized: now 1779114363738976 us; error 33 us; skew 500 ppm
14:26:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.739830 21051 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:03.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.747299 21051 webserver.cc:533] Webserver started at http://127.20.103.124:44711/ using document root <none> and password file <none>
14:26:03.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.748581 21051 fs_manager.cc:362] Metadata directory not provided
14:26:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.749012 21051 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.749670 21051 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:03.750 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:03.750 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:03.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.751 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:03.751 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:03.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:03.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:03.751 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.756011 21051 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data/instance:
14:26:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d996969dcc64a25a902c1100fcf9cde"
14:26:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:03 on dist-test-slave-1n46"
14:26:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.757521 21051 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal/instance:
14:26:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d996969dcc64a25a902c1100fcf9cde"
14:26:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:03 on dist-test-slave-1n46"
14:26:03.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.767007 21051 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.003s
14:26:03.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.773700 21080 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.774806 21051 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.775121 21051 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d996969dcc64a25a902c1100fcf9cde"
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:03 on dist-test-slave-1n46"
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.775406 21051 fs_report.cc:389] FS layout report
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal
14:26:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data/data
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:03.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:03.803 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:03.803 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:03.803 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:03.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.803 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.803 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.804 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.804 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.804 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:03.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:03.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:03.808 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:03.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.808 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:03.808 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.808 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:03.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:03.809 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:03.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.840580 21051 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:03.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.842010 21051 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:03.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.842491 21051 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:03.846 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:03.847 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:03.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:03.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:03.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:03.847 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:03.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:03.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:03.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:03.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:03.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:03.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:03.847 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:03.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:03.891 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:03.891 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:03.891 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:03.891 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:03.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:03.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:03.892 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:03.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:03.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:03.892 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:03.892 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:03.892 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:03.892 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:03.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.934202 21051 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.124:41795
14:26:03.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.934299 21131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.124:41795 every 8 connection(s)
14:26:03.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.936882 21051 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/data/info.pb
14:26:03.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.943416 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 21051
14:26:03.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.943876 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/master-2/wal/instance
14:26:03.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.944450 21132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:03.949 [DEBUG - pool-312-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.18.72.252:44649, [5ms] received response from server master-127.18.72.252:44649: OK, deferred=null) with no deferred attached!
14:26:03.949 [DEBUG - pool-312-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.18.72.252:44649, [21ms] received response from server master-127.18.72.252:44649: OK, deferred=null) with no deferred attached!
14:26:03.949 [DEBUG - pool-312-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.18.72.252:44649, [7ms] received response from server master-127.18.72.252:44649: OK, deferred=null) with no deferred attached!
14:26:03.949 [DEBUG - pool-312-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.18.72.252:44649, [6ms] received response from server master-127.18.72.252:44649: OK, deferred=null) with no deferred attached!
14:26:03.949 [DEBUG - pool-312-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.18.72.252:44649, [15ms] received response from server master-127.18.72.252:44649: OK, deferred=null) with no deferred attached!
14:26:03.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.962163 21132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } has no permanent_uuid. Determining permanent_uuid...
14:26:03.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.985461 21132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } has no permanent_uuid. Determining permanent_uuid...
14:26:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:03.995687 21132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } has no permanent_uuid. Determining permanent_uuid...
14:26:04.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.014449 21132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: Bootstrap starting.
14:26:04.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.021942 21132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: Neither blocks nor log segments found. Creating new log.
14:26:04.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.023818 21132 log.cc:826] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: Log is configured to *not* fsync() on all Append() calls
14:26:04.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.028937 21132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: No bootstrap required, opened a new log
14:26:04.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.048631 21132 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.049261 21132 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:04.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.049631 21132 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d996969dcc64a25a902c1100fcf9cde, State: Initialized, Role: FOLLOWER
14:26:04.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.050455 21132 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.052727 21141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.053380 21141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.054275 21132 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: configured and running, proceeding with master startup.
14:26:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.081106 21152 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:26:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.081430 21152 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:26:04.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.099520 21086 tablet.cc:2404] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:04.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.076627 21051 master_runner.cc:187] Error getting master registration for 127.20.103.126:39327: OK, instance_id { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" instance_seqno: 1779114359765903 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:04.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.102814 21051 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:04.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.122512 21049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 7
14:26:04.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.140919 21049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: Bootstrap starting.
14:26:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.146652 21049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: Neither blocks nor log segments found. Creating new log.
14:26:04.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.148465 21049 log.cc:826] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: Log is configured to *not* fsync() on all Append() calls
14:26:04.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.155102 21049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: No bootstrap required, opened a new log
14:26:04.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.176952 21049 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.177810 21049 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:04.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.178251 21049 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed85f0c585847a8aed1cb4ba377d63e, State: Initialized, Role: FOLLOWER
14:26:04.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.179118 21049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.181715 21156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.182502 21156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.183406 21049 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: configured and running, proceeding with master startup.
14:26:04.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114364185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:04.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.196 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:04.196 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:26:04.220 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.228569 21167 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:26:04.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.229074 21167 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:26:04.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.215833 20976 master_runner.cc:187] Error getting master registration for 127.20.103.126:39327: OK, instance_id { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" instance_seqno: 1779114359765903 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:04.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.252794 20976 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:04.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.370988 21156 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:04.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.371516 21156 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.375331 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d996969dcc64a25a902c1100fcf9cde" is_pre_election: true
14:26:04.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.376261 21107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ed85f0c585847a8aed1cb4ba377d63e in term 0.
14:26:04.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.377797 21001 leader_election.cc:304] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed85f0c585847a8aed1cb4ba377d63e, 5d996969dcc64a25a902c1100fcf9cde; no voters: 
14:26:04.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.383724 21156 leader_election.cc:290] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffcb4321dac944eea2b2ec381b7ba352 (127.20.103.126:39327), 5d996969dcc64a25a902c1100fcf9cde (127.20.103.124:41795)
14:26:04.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.384588 21156 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:04.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.384977 21156 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:04.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.385398 21156 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 0 FOLLOWER]: Advancing to term 1
14:26:04.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.397231 21156 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.397883 21003 tablet.cc:2404] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:04.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.402390 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d996969dcc64a25a902c1100fcf9cde"
14:26:04.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.402951 21107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 0 FOLLOWER]: Advancing to term 1
14:26:04.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.410645 21107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed85f0c585847a8aed1cb4ba377d63e in term 1.
14:26:04.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.411643 21001 leader_election.cc:304] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed85f0c585847a8aed1cb4ba377d63e, 5d996969dcc64a25a902c1100fcf9cde; no voters: 
14:26:04.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.412443 21170 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 1 FOLLOWER]: Leader election won for term 1
14:26:04.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.413653 21156 leader_election.cc:290] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [CANDIDATE]: Term 1 election: Requested vote from peers ffcb4321dac944eea2b2ec381b7ba352 (127.20.103.126:39327), 5d996969dcc64a25a902c1100fcf9cde (127.20.103.124:41795)
14:26:04.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:04.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:04.421 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:04.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:04.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:04.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:04.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:04.421 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:04.421 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:04.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:04.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:04.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:04.421 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:04.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.422310 21170 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [term 1 LEADER]: Becoming Leader. State: Replica: 2ed85f0c585847a8aed1cb4ba377d63e, State: Running, Role: LEADER
14:26:04.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.423386 21170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.440644 21156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed85f0c585847a8aed1cb4ba377d63e. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.441336 21156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: This master's current role is: LEADER
14:26:04.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.452421 21173 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:26:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.460054 21173 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:26:04.470 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:04.470 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:04.470 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:04.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:04.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:04.470 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:04.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:04.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:04.471 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:04.471 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:04.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:04.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:04.471 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:04.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.481528 21107 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [term 1 FOLLOWER]: Refusing update from remote peer 2ed85f0c585847a8aed1cb4ba377d63e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.484465 21156 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.489562 20974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } attempt: 7
14:26:04.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.524017 20974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: Bootstrap starting.
14:26:04.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.527652 21141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed85f0c585847a8aed1cb4ba377d63e. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.528282 21141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.531095 20974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: Neither blocks nor log segments found. Creating new log.
14:26:04.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.533322 20974 log.cc:826] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: Log is configured to *not* fsync() on all Append() calls
14:26:04.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.546202 20974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: No bootstrap required, opened a new log
14:26:04.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.550992 21170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.551761 21170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: This master's current role is: LEADER
14:26:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.554672 21173 catalog_manager.cc:1383] Generated new cluster ID: 4abacd8a8b4d404cb644f060a4dba2f5
14:26:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.554957 21173 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:26:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.555282 21141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.555967 21141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.608883 21176 mvcc.cc:204] Tried to move back new op lower bound from 7287252436897165312 to 7287252436687577088. Current Snapshot: MvccSnapshot[applied={T|T < 7287252436897165312}]
14:26:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.610289 20974 raft_consensus.cc:359] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.612470 20974 raft_consensus.cc:385] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:04.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.618366 20974 raft_consensus.cc:740] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffcb4321dac944eea2b2ec381b7ba352, State: Initialized, Role: FOLLOWER
14:26:04.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.619560 20974 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } }
14:26:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.626909 21173 catalog_manager.cc:1406] Generated new certificate authority record
14:26:04.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.630044 21173 catalog_manager.cc:1540] Loading token signing keys...
14:26:04.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.649719 20974 sys_catalog.cc:565] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: configured and running, proceeding with master startup.
14:26:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.649911 20948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcb4321dac944eea2b2ec381b7ba352"
14:26:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.650949 20949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcb4321dac944eea2b2ec381b7ba352" is_pre_election: true
14:26:04.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.653930 20948 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 0 FOLLOWER]: Advancing to term 1
14:26:04.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.653724 21181 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.659771 21181 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.664427 20948 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed85f0c585847a8aed1cb4ba377d63e in term 1.
14:26:04.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.667321 21173 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e: Generated new TSK 0
14:26:04.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.668439 21173 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.681573 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/logs
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data/info.pb
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.65:0
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.65
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.65
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:04.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:04.687 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114364686 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:04.694 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:04.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:26:04.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.695133 20947 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [term 1 FOLLOWER]: Refusing update from remote peer 2ed85f0c585847a8aed1cb4ba377d63e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:04.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.697832 21156 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:04.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:04.710645 20927 tablet.cc:2404] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:04.719 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.774911 21181 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed85f0c585847a8aed1cb4ba377d63e. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.775624 21181 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.777274 21193 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:04.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.778024 21193 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352 [sys.catalog]: This master's current role is: FOLLOWER
14:26:04.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.830180 21198 catalog_manager.cc:1295] Loaded cluster ID: 4abacd8a8b4d404cb644f060a4dba2f5
14:26:04.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.830453 21198 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: loading cluster ID for follower catalog manager: success
14:26:04.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.850875 21198 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: acquiring CA information for follower catalog manager: success
14:26:04.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:04.859 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:04.860 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:04.860 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:04.860 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:04.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:04.860 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:04.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:04.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:04.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:04.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:04.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:04.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:04.864 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:04.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:04.869516 21198 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ffcb4321dac944eea2b2ec381b7ba352: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:05.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.086799 21152 catalog_manager.cc:1295] Loaded cluster ID: 4abacd8a8b4d404cb644f060a4dba2f5
14:26:05.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.087283 21152 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: loading cluster ID for follower catalog manager: success
14:26:05.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.094079 21152 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: acquiring CA information for follower catalog manager: success
14:26:05.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.098893 21152 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 5d996969dcc64a25a902c1100fcf9cde: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:05.109 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:05.110 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:05.110 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:05.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:05.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:05.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:05.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:05.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:05.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:05.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:05.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:05.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:05.111 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:05.130 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:05.130 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:05.131 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:05.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:05.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:05.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:05.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:05.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:05.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:05.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:05.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:05.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:05.131 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:05.186 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114365185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:05.195 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:26:05.195 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:26:05.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.219 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.271 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:05.271 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:05.272 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:05.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.272 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.272 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.273 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.273 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.273 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:05.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.305387 21202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcb4321dac944eea2b2ec381b7ba352" member_type: VOTER last_known_addr { host: "127.20.103.126" port: 39327 } } peers { permanent_uuid: "2ed85f0c585847a8aed1cb4ba377d63e" member_type: VOTER last_known_addr { host: "127.20.103.125" port: 34309 } } peers { permanent_uuid: "5d996969dcc64a25a902c1100fcf9cde" member_type: VOTER last_known_addr { host: "127.20.103.124" port: 41795 } } }
14:26:05.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.314193 21202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed85f0c585847a8aed1cb4ba377d63e [sys.catalog]: This master's current role is: LEADER
14:26:05.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.449 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:05.449 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:05.449 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:05.449 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.449 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.450 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.450 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.450 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.450 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.450 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.450 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.450 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:05.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.452692 21185 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:05.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.453384 21185 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:05.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.454248 21185 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:05.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.518487 21185 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:05.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.520074 21185 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.103.65
14:26:05.539 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:05.540 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:05.540 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:05.540 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.540 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.540 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.540 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.540 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.540 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.541 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.541 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.541 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.541 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:05.623 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:05.624 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:05.624 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:05.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.624 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.624 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.624 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.624 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.624 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.624 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.629336 21185 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.65:0
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data/info.pb
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.65
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.65
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/logs
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.631532 21185 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:05.633697 21185 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:05.664 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:05.664 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:05.664 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:05.664 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.664 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.664 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.665 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:05.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.667819 21209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:05.686 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114365686 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:05.695 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:05.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:26:05.696 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.756 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:05.756 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:05.756 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:05.756 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.757 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.757 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.757 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:05.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:05.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:05.760 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:05.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:05.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:05.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:05.760 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:05.806 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:05.807 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:05.807 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:05.807 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:05.807 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:05.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:05.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:05.808 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:05.808 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:05.808 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:05.808 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:05.807 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:05.808 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:05.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:05.895 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:05.895 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:05.896 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:05.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:05.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:05.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:05.896 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:05.928 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:05.929 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:05.929 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:05.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:05.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:05.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:05.930 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:06.006 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:06.006 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:06.006 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:06.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:06.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:06.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:06.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:06.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:06.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:06.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:06.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:06.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:06.008 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:06.027 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:06.027 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:06.028 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:06.028 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.028 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.028 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.028 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.028 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.029 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.029 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.029 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.029 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:06.130 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:06.130 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:06.130 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:06.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.132 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.132 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:06.146 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:06.146 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:06.147 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:06.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.148 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.148 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.148 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:06.185 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114366185 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:06.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.197 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:26:06.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:26:06.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.446 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:06.447 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:06.447 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:06.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.447 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.447 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.447 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.447 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.447 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:06.540 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:06.540 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:06.541 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:06.541 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:06.541 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:06.541 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:06.541 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:06.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:06.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:06.542 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:06.542 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:06.542 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:06.542 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:06.685 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114366685 for job 01c353b3dfaac48d363fa91db2a11301.
14:26:06.689 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:06.689 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:06.690 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:06.690 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.690 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.690 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:06.690 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:06.691 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.691 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.691 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:06.691 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:06.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.695 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 01c353b3dfaac48d363fa91db2a11301 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:26:06.696 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:26:06.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.731 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:06.731 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:06.731 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:06.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.731 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.731 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.732 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:06.787 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:06.787 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:06.787 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:06.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:06.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:06.788 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.788 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.788 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:06.788 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:06.816 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:06.816 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:06.817 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:06.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:06.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:06.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:06.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:06.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:06.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:06.818 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:06.818 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:06.818 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:06.818 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:06.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:06.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:06.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:06.866 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:06.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:06.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:06.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:06.867 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:06.868 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27113), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [33ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [105ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [105ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [602ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [602ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [661ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4099ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4100ms] too many traces: truncated at 100 traces, deferred=Deferred@148837160(state=PENDING, result=null, callback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970), errback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970)))
14:26:06.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:26:06.870 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27113), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [33ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [105ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [105ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [602ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [602ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [661ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4099ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4100ms] too many traces: truncated at 100 traces, deferred=Deferred@148837160(state=PENDING, result=null, callback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970), errback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:06.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
14:26:06.873 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
14:26:06.876 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27113), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [33ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [68ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [105ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [105ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [320ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [481ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [481ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [601ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [602ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [602ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [661ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [661ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2200ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2201ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [4099ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [4100ms] too many traces: truncated at 100 traces, deferred=Deferred@148837160(state=PENDING, result=null, callback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970), errback=(continuation of Deferred@27913819 after retry RPC after error@1268973457) -> (continuation of Deferred@2105634266 after retry RPC after error@230123281) -> (continuation of Deferred@1126341578 after retry RPC after error@522234440) -> (continuation of Deferred@1765403595 after retry RPC after error@1602258450) -> (continuation of Deferred@145472227 after retry RPC after error@306393940) -> (continuation of Deferred@880993636 after retry RPC after error@1869174256) -> (continuation of Deferred@985699932 after retry RPC after error@823319491) -> (continuation of Deferred@303608128 after retry RPC after error@930852902) -> (continuation of Deferred@154645219 after retry RPC after error@777829573) -> (continuation of Deferred@2040105727 after retry RPC after error@327806826) -> (continuation of Deferred@664659794 after retry RPC after error@1819074032) -> (continuation of Deferred@1503100144 after retry RPC after error@87632407) -> (continuation of Deferred@1305930389 after retry RPC after error@1205808514) -> (continuation of Deferred@634235253 after retry RPC after error@1776834121) -> (continuation of Deferred@319855523 after retry RPC after error@756881278) -> (continuation of Deferred@1708361129 after retry RPC after error@1319296324) -> (continuation of Deferred@1509460656 after retry RPC after error@471580694) -> (continuation of Deferred@1704784113 after retry RPC after error@1024215547) -> (continuation of Deferred@540867040 after retry RPC after error@1659213441) -> (continuation of Deferred@1618798932 after retry RPC after error@1071658801) -> (continuation of Deferred@2027170516 after retry RPC after error@910944977) -> (continuation of Deferred@838501125 after retry RPC after error@253584308) -> (continuation of Deferred@1447459337 after retry RPC after error@1068633970)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:06.877 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:06.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
14:26:06.883 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
14:26:06.883 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:26:06.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:06.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:06.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:06.971 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.971 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.971 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.971 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.971 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:06.971 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.971 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.971 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:06.971 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:06.972 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:07.110 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.111 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.111 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.111 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.111 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.111 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.111 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.111 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.111 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.112 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.112 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.112 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.112 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.113 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27682), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [2ms] received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [23ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [24ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [83ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [202ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [310ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [502ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [504ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [504ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1582ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1583ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2922ms] refreshing cache from master, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2924ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4741ms] refreshing cache from master, [4741ms] too many traces: truncated at 100 traces, deferred=Deferred@457593588(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@53409188 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552)))
14:26:07.114 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.114 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.114 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.114 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27682), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [2ms] received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [23ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [24ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [83ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [202ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [310ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [502ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [504ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [504ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1582ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1583ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2922ms] refreshing cache from master, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2924ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4741ms] refreshing cache from master, [4741ms] too many traces: truncated at 100 traces, deferred=Deferred@457593588(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@53409188 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27682), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [2ms] received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [23ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [24ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [83ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [202ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [310ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [502ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [504ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [504ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1582ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1583ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2922ms] refreshing cache from master, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2924ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4741ms] refreshing cache from master, [4741ms] too many traces: truncated at 100 traces, deferred=Deferred@457593588(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@53409188 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:07.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.115 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.115 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.115 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.118 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27682), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [2ms] received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [23ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [24ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [83ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [202ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [310ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [502ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [504ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [504ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1582ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1583ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2922ms] refreshing cache from master, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2924ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4741ms] refreshing cache from master, [4741ms] too many traces: truncated at 100 traces, deferred=Deferred@457593588(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@53409188 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27682), Traces: [0ms] sending RPC to server master-127.17.128.60:42293, [2ms] received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [23ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [24ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [24ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [83ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [83ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [202ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [303ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [310ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [502ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [503ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [504ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [504ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1582ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1583ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2922ms] refreshing cache from master, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2924ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4741ms] refreshing cache from master, [4741ms] too many traces: truncated at 100 traces, deferred=Deferred@457593588(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@53409188 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1243151536 after retry RPC after error@1369378419) -> (continuation of Deferred@2028414790 after retry RPC after error@796665091) -> (continuation of Deferred@579645728 after retry RPC after error@197779348) -> (continuation of Deferred@1255478460 after retry RPC after error@80700632) -> (continuation of Deferred@1124974800 after retry RPC after error@108888666) -> (continuation of Deferred@1684997853 after retry RPC after error@460932908) -> (continuation of Deferred@912203731 after retry RPC after error@1557804048) -> (continuation of Deferred@1084197048 after retry RPC after error@294578080) -> (continuation of Deferred@1600242629 after retry RPC after error@1385563789) -> (continuation of Deferred@1861258799 after retry RPC after error@136697782) -> (continuation of Deferred@1493910172 after retry RPC after error@1003193694) -> (continuation of Deferred@1369503230 after retry RPC after error@1998458907) -> (continuation of Deferred@1946334150 after retry RPC after error@327432557) -> (continuation of Deferred@1163731430 after retry RPC after error@1120173982) -> (continuation of Deferred@599353475 after retry RPC after error@289694408) -> (continuation of Deferred@1035608855 after retry RPC after error@1558414257) -> (continuation of Deferred@880154078 after retry RPC after error@102134714) -> (continuation of Deferred@1792563956 after retry RPC after error@719761941) -> (continuation of Deferred@775588466 after retry RPC after error@461678508) -> (continuation of Deferred@866341330 after retry RPC after error@751451049) -> (continuation of Deferred@1448693080 after retry RPC after error@1759390200) -> (continuation of Deferred@1104861424 after retry RPC after error@1018209297) -> (continuation of Deferred@547294546 after retry RPC after error@957833552)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:07.119 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:07.119 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RUNNING to RESTARTING.
14:26:07.119 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
14:26:07.119 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:26:07.120 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:07.120 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:26:07.120 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:07.120 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
14:26:07.120 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:26:07.121 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:26:07.121 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:26:07.121 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
14:26:07.121 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:26:07.130 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.130 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.130 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.131 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.131 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.132 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state TERMINATED
14:26:07.132 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state TERMINATED
14:26:07.132 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state TERMINATED
14:26:07.134 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:07.134 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:07.134 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:26:07.151 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.151 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.151 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.151 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.151 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.151 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.152 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.152 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.152 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.152 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.152 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.162 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:07.162 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:26:07.162 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:07.170 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state TERMINATED
14:26:07.170 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state TERMINATED
14:26:07.170 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state TERMINATED
14:26:07.171 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:07.171 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:07.171 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:07.170 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.172 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.172 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.173 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.185 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:07.185 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:07.186 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:26:07.186 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:07.190 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.190 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.190 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.191 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.191 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.191 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.192 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:07.192 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:26:07.192 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:07.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.197 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 3d46e3ac247443b18c01517e6b29eeab(127.18.72.193:35669)] disconnecting while in state TERMINATED
14:26:07.197 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state TERMINATED
14:26:07.197 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state TERMINATED
14:26:07.197 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state TERMINATED
14:26:07.198 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:07.198 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:07.198 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:26:07.199 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
14:26:07.214 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
14:26:07.215 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:07.215 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:26:07.215 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:07.231 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:07.231 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.231 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.231 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.231 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.231 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.232 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.232 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.231 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:26:07.233 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:07.239 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.18.72.254:35143(127.18.72.254:35143)] disconnecting while in state TERMINATED
14:26:07.239 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.18.72.252:44649(127.18.72.252:44649)] disconnecting while in state TERMINATED
14:26:07.240 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.18.72.253:45261(127.18.72.253:45261)] disconnecting while in state TERMINATED
14:26:07.240 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:07.241 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
14:26:07.241 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:07.250 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.251 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.251 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.251 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.251 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.251 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.251 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.251 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.258 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:07.258 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:26:07.258 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:26:07.259 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:07.264 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
14:26:07.264 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
14:26:07.264 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
14:26:07.265 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:26:07.265 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:26:07.266 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:26:07.266 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:07.267 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:07.267 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:07.270 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.270 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.271 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.272 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-1
14:26:07.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.272 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.272 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:07.273 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:26:07.273 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:07.273 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:26:07.273 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:26:07.274 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 01c353b3dfaac48d363fa91db2a11301
14:26:07.330 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.330 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.330 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.331 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.331 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.331 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.331 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.331 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.331 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.331 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.403 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:07.404 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:07.404 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:07.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.404 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.404 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.404 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.404 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:07.424 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:07.424 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:07.424 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:07.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.425 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:07.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:07.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.425 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:07.426 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:07.470 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:07.471 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:07.471 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:07.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:07.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:07.473 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.473 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:07.473 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:07.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:07.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:07.496 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:07.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.497 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.497 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.497 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:07.529 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:07.529 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:07.529 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:07.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:07.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:07.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:07.531 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:07.531 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:07.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:07.531 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:07.531 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:07.531 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:07.532 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:07.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:07.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:07.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:07.868 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:07.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:07.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:07.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:07.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:08.122 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:08.123 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:08.123 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:08.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.123 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.123 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:08.139 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RESTARTING to RUNNING.
14:26:08.140 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 01c353b3dfaac48d363fa91db2a11301 from Checkpoint 66 @ 1779114366685 for 01c353b3dfaac48d363fa91db2a11301 located at file:/tmp/junit12845694439211909930/checkpoints/01c353b3dfaac48d363fa91db2a11301/chk-66.
14:26:08.140 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
14:26:08.140 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:08.143 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
14:26:08.144 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
14:26:08.144 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 7e4df4c5072cc4cbd3d010fcf80896db
14:26:08.145 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:26:08.145 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:26:08.145 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id f637657deada1029ec0e73b52fd27482
14:26:08.145 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
14:26:08.146 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7e4df4c5072cc4cbd3d010fcf80896db.
14:26:08.147 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 7e4df4c5072cc4cbd3d010fcf80896db.
14:26:08.147 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:08.148 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:08.148 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:08.148 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
14:26:08.148 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 6295e036bf819b517a25e7bc93bbccc6
14:26:08.149 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
14:26:08.149 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
14:26:08.149 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 502ab7224a4d234d987b3014c28d82e3
14:26:08.149 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:08.150 [INFO - Thread-56] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:08.151 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.17.128.60:42293(127.17.128.60:42293)] disconnecting while in state TERMINATED
14:26:08.151 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.17.128.61:34199(127.17.128.61:34199)] disconnecting while in state TERMINATED
14:26:08.151 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.17.128.62:37019(127.17.128.62:37019)] disconnecting while in state TERMINATED
14:26:08.153 [DEBUG - Thread-56] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:08.153 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:26:08.153 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:08.153 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f637657deada1029ec0e73b52fd27482.
14:26:08.154 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
14:26:08.154 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id f637657deada1029ec0e73b52fd27482.
14:26:08.155 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
14:26:08.155 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
14:26:08.155 [INFO - Thread-56] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:08.156 [INFO - Thread-56] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:08.156 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@33f267bb
14:26:08.156 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:08.156 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:08.157 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:26:08.157 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:26:08.159 [DEBUG - Thread-56] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:08.159 [INFO - Thread-56] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:08.161 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 6295e036bf819b517a25e7bc93bbccc6.
14:26:08.162 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 6295e036bf819b517a25e7bc93bbccc6.
14:26:08.163 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:26:08.163 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:26:08.163 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7667c84d
14:26:08.163 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ab831ba
14:26:08.163 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:08.166 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:08.166 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 502ab7224a4d234d987b3014c28d82e3.
14:26:08.167 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 502ab7224a4d234d987b3014c28d82e3.
14:26:08.167 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
14:26:08.167 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
14:26:08.168 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f9b5db0
14:26:08.168 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:08.168 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:08.168 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:26:08.168 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:26:08.166 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:08.166 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:26:08.169 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:26:08.170 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3088bbd1
14:26:08.172 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4558d353
14:26:08.174 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:08.180 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
14:26:08.180 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
14:26:08.181 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@22589d3e
14:26:08.181 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:08.181 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:08.181 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:26:08.181 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:26:08.183 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60924949
14:26:08.187 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:08.187 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:08.187 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:08.187 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:08.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.195 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:08.199 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:08.205 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.206 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.225 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.230 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.237 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.239 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.243 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.244 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.244 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.248 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.248 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.248 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.254 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.258 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.259 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.259 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.263 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.263 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.263 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.263 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.266 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.269 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.270 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.274 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.276 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.276 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.276 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.281 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.285 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.286 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.288 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.295 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.299 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:08.299 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:08.299 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:08.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.301 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.301 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.301 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.301 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:08.305 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.306 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.306 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.310 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.314 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.326 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.326 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.326 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.327 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.327 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.327 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.331 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.331 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.335 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.338 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.339 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:08.339 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:08.340 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:08.340 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.340 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.340 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.340 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.340 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.340 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:08.345 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.345 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.345 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.345 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.346 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.347 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.347 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.347 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.348 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.348 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.349 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.349 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.349 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.349 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.349 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.349 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.349 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.350 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.350 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.351 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.351 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.351 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.352 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.352 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.352 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.352 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.352 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.353 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.354 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.355 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.355 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.355 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.356 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.356 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.356 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.356 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.357 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.361 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.361 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.361 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.362 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.365 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.365 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.365 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.366 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.366 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.366 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.366 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.366 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.367 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.367 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.367 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:08.368 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:08.368 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:08.368 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.368 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.368 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.369 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.369 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:08.371 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.372 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.377 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.377 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.377 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.377 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.384 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.385 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.385 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.386 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.386 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.386 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.386 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.387 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.385 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.387 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.387 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.387 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.388 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.388 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.388 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.388 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.389 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.389 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.389 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.385 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.389 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.389 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.389 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.390 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.390 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.390 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.390 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.390 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.395 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.406 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.406 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.406 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.406 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.406 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.406 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.407 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.407 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.407 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.407 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.407 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.407 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.407 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.410 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.411 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.411 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.411 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.411 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.414 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:08.414 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:08.414 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:08.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:08.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:08.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:08.415 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:08.418 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.418 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.418 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.418 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.425 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.426 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.426 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.426 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.426 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.426 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.426 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.426 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.426 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.426 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.427 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.427 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.427 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.427 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.427 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.427 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.428 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.428 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.428 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.429812 20290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.148.62:34807, user_credentials={real_user=slave}} blocked reactor thread for 46308.3us
14:26:08.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.432 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.445 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.446 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.446 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.446 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.446 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.446 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.446 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.446 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.447 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.448 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.450 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.450 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.451 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.451 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.451 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.451 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.451 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.451 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.451 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.451 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.451 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.452 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.454 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.455 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.465 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.465 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.465 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.465 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.465 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.465 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.465 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.466 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.466 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.466 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.466 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.466 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.465 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.467 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.470 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.470 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.470 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.471 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:08.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.471 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:08.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.471 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.471 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:08.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.471 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.471 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.472 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.472 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.472 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.472 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:08.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.472 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.472 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.472 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.472 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.472 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.472 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.472 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.472 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [32ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [58ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [59ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [521ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2742ms] too many traces: truncated at 100 traces, deferred=Deferred@1172528431(state=PENDING, result=null, callback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875), errback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875)))
14:26:08.473 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:26:08.473 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [32ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [58ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [59ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [521ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2742ms] too many traces: truncated at 100 traces, deferred=Deferred@1172528431(state=PENDING, result=null, callback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875), errback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:08.474 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
14:26:08.476 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
14:26:08.519 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.519 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.519 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.520 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.520 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.520 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.520 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.520 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.520 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.520 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.520 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.520 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.520 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.520 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.520 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.521 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.521 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.521 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.521 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.521 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.521 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.521 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.522 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [32ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [58ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [59ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [60ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [84ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [521ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [521ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2742ms] too many traces: truncated at 100 traces, deferred=Deferred@1172528431(state=PENDING, result=null, callback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875), errback=(continuation of Deferred@187962760 after retry RPC after error@1152090060) -> (continuation of Deferred@300610898 after retry RPC after error@1312802917) -> (continuation of Deferred@1695288447 after retry RPC after error@2059819533) -> (continuation of Deferred@1010856034 after retry RPC after error@210565999) -> (continuation of Deferred@157704565 after retry RPC after error@1094210662) -> (continuation of Deferred@2118446915 after retry RPC after error@360199271) -> (continuation of Deferred@800035444 after retry RPC after error@741832835) -> (continuation of Deferred@1968219313 after retry RPC after error@559902064) -> (continuation of Deferred@1924163357 after retry RPC after error@1700063912) -> (continuation of Deferred@357674911 after retry RPC after error@1337943208) -> (continuation of Deferred@1044802253 after retry RPC after error@2080753159) -> (continuation of Deferred@1680913231 after retry RPC after error@1344143685) -> (continuation of Deferred@1560480137 after retry RPC after error@258267600) -> (continuation of Deferred@1848617400 after retry RPC after error@1310431505) -> (continuation of Deferred@194092570 after retry RPC after error@580025569) -> (continuation of Deferred@836989794 after retry RPC after error@597866334) -> (continuation of Deferred@616860798 after retry RPC after error@352360819) -> (continuation of Deferred@1062371538 after retry RPC after error@167565345) -> (continuation of Deferred@165351964 after retry RPC after error@402774357) -> (continuation of Deferred@872324759 after retry RPC after error@1554801945) -> (continuation of Deferred@221693794 after retry RPC after error@468417760) -> (continuation of Deferred@1554404140 after retry RPC after error@1671262476) -> (continuation of Deferred@1479260106 after retry RPC after error@409455699) -> (continuation of Deferred@1983300416 after retry RPC after error@2116798875)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:08.522 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.522 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.522 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.523 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.523 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:08.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.523 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.523 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.523 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.523 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.523 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
14:26:08.524 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.524 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
14:26:08.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.546 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.547 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.551 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.551 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.551 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.551 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.551 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.552 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.552 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.552 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.553 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.553 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.553 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.553 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.565 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.565 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.565 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.565 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.565 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.566 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.566 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.566 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.583 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:08.583 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:08.583 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:08.583 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:08.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:08.584 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:08.584 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:08.586 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.586 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.586 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.587 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.587 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.587 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.587 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.587 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.590 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.591 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.591 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.591 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.591 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.591 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.592 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.592 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.592 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.592 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.592 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.592 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.592 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.592 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.592 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.592 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.593 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.646 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.647 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.647 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.648 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.648 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.648 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.691 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.691 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.691 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.692 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.692 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.692 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.693 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.693 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.693 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.693 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.746 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.746 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.746 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.747 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.747 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.747 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.748 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.748 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.748 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.748 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.811 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.812 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.812 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.812 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.812 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.812 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.812 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.813 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:08.871 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:08.871 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:08.871 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:08.872 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.872 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.872 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:08.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:08.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:08.873 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:05.682386 21210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:07.057693 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 21185
14:26:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.878841 21208 kernel_stack_watchdog.cc:198] Thread 21185 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 379ms:
14:26:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:26:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:26:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:26:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:26:08.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.886596 21185 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.210s	user 0.423s	sys 0.788s
14:26:08.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.887187 21185 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.211s	user 0.423s	sys 0.788s
14:26:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.887858 21211 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 3200 milliseconds
14:26:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:08.888236 21212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.888343 21185 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:08.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.889807 21185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:08.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.897998 21185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:08.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.899392 21185 hybrid_clock.cc:648] HybridClock initialized: now 1779114368899325 us; error 56 us; skew 500 ppm
14:26:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.900367 21185 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:08.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:08.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:08.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:08.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.926 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:08.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.927 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:08.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:08.927 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:08.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:08.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:08.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:08.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.928 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.928 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:08.928 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:08.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:08.928 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.944839 21185 webserver.cc:533] Webserver started at http://127.20.103.65:46355/ using document root <none> and password file <none>
14:26:08.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.946266 21185 fs_manager.cc:362] Metadata directory not provided
14:26:08.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.946592 21185 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:08.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.947230 21185 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.953734 21185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data/instance:
14:26:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:08 on dist-test-slave-1n46"
14:26:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.955147 21185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal/instance:
14:26:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:08 on dist-test-slave-1n46"
14:26:08.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.964565 21185 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
14:26:08.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.972038 21296 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:08.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.973376 21185 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.973743 21185 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:08 on dist-test-slave-1n46"
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:08.974169 21185 fs_report.cc:389] FS layout report
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data/data
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:08.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:08.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:09.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.038157 21185 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:09.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.040169 21185 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:09.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.040727 21185 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:09.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.044214 21185 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:09.045 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:09.045 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:09.045 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:09.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.046 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:09.047 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:09.047 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:09.048 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:09.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.048 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.050359 21185 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.050658 21185 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.050987 21185 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.051214 21185 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:09.066 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.066 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.066 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.066 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.067 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.067 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.067 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.068 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29312), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [12ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [54ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [54ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [428ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [4922ms] too many traces: truncated at 100 traces, deferred=Deferred@2138994511(state=PENDING, result=null, callback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478), errback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478)))
14:26:09.069 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.069 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.069 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.069 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.069 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.069 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.069 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29312), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [12ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [54ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [54ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [428ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [4922ms] too many traces: truncated at 100 traces, deferred=Deferred@2138994511(state=PENDING, result=null, callback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478), errback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29312), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [12ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [54ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [54ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [428ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [4922ms] too many traces: truncated at 100 traces, deferred=Deferred@2138994511(state=PENDING, result=null, callback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478), errback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:09.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.070 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.081 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29312), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [12ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [54ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [54ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [428ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [4922ms] too many traces: truncated at 100 traces, deferred=Deferred@2138994511(state=PENDING, result=null, callback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478), errback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29312), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [12ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [54ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [54ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [428ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [4922ms] too many traces: truncated at 100 traces, deferred=Deferred@2138994511(state=PENDING, result=null, callback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478), errback=(continuation of Deferred@379433507 after retry RPC after error@895767336) -> (continuation of Deferred@629026505 after retry RPC after error@691462438) -> (continuation of Deferred@1380012681 after retry RPC after error@1160488698) -> (continuation of Deferred@301449456 after retry RPC after error@265698361) -> (continuation of Deferred@1474028112 after retry RPC after error@1340047911) -> (continuation of Deferred@1610627948 after retry RPC after error@1577710753) -> (continuation of Deferred@1447580754 after retry RPC after error@1697987078) -> (continuation of Deferred@76527255 after retry RPC after error@355657307) -> (continuation of Deferred@21809771 after retry RPC after error@1298478414) -> (continuation of Deferred@874973563 after retry RPC after error@916795802) -> (continuation of Deferred@1365093047 after retry RPC after error@905325207) -> (continuation of Deferred@966168963 after retry RPC after error@639655626) -> (continuation of Deferred@445927595 after retry RPC after error@515007484) -> (continuation of Deferred@321250080 after retry RPC after error@928463232) -> (continuation of Deferred@268318409 after retry RPC after error@39721289) -> (continuation of Deferred@1046398657 after retry RPC after error@818635699) -> (continuation of Deferred@1316836125 after retry RPC after error@1008439242) -> (continuation of Deferred@1958424134 after retry RPC after error@520494489) -> (continuation of Deferred@1002918111 after retry RPC after error@1531116978) -> (continuation of Deferred@1990599042 after retry RPC after error@1508053018) -> (continuation of Deferred@1478746705 after retry RPC after error@348138378) -> (continuation of Deferred@1395503777 after retry RPC after error@311368478)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.125:45957
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:09.083 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:09.083 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
14:26:09.083 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
14:26:09.083 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:26:09.084 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
14:26:09.084 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:26:09.085 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
14:26:09.085 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
14:26:09.086 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.087 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.087 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.087 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.087 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.088 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.088 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.088 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.093 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:26:09.093 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
14:26:09.093 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
14:26:09.099 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
14:26:09.099 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
14:26:09.099 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
14:26:09.100 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:26:09.100 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
14:26:09.101 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
14:26:09.106 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.106 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.106 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.107 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.107 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.107 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.107 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.107 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.107 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.108 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.108 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.108 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.108 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.110 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
14:26:09.110 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
14:26:09.111 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
14:26:09.111 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:09.112 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
14:26:09.112 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 77d052e6e51b5ae35525074f80512696
14:26:09.126 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.126 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.126 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.127 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.139 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.139 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.146 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:09.146 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:09.146 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:09.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.146 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.146 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:09.166 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.166 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.166 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.166 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.166 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.166 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.166 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.166 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.167 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.167 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.207 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.207 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.207 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.207 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.207 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.207 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.207 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.208 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.208 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.208 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.207 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.208 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.266 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.266 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.266 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.267 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.267 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.268 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.281 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:09.281 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:09.281 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:09.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.282 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.282 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.282 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.321424 21185 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.65:40757
14:26:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.321535 21414 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.65:40757 every 8 connection(s)
14:26:09.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.325156 21185 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/data/info.pb
14:26:09.326 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.327 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.327 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.327 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.327 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.327 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.327 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.327 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.327 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.328 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.328 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.328 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.328 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.334098 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 21185
14:26:09.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.334870 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-0/wal/instance
14:26:09.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.358982 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/logs
14:26:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data/info.pb
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.66:0
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.66
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.66
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:09.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.380267 21416 heartbeater.cc:344] Connected to a master server at 127.20.103.125:34309
14:26:09.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.380779 21416 heartbeater.cc:461] Registering TS with master...
14:26:09.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.382157 21416 heartbeater.cc:507] Master 127.20.103.125:34309 requested a full tablet report, sending...
14:26:09.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.387648 21014 ts_manager.cc:194] Registered new tserver with Master: 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757)
14:26:09.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.390095 21014 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.103.65:54437
14:26:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.390883 21415 heartbeater.cc:344] Connected to a master server at 127.20.103.124:41795
14:26:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.392581 21415 heartbeater.cc:461] Registering TS with master...
14:26:09.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.394668 21415 heartbeater.cc:507] Master 127.20.103.124:41795 requested a full tablet report, sending...
14:26:09.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.397658 21097 ts_manager.cc:194] Registered new tserver with Master: 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757)
14:26:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.403664 21417 heartbeater.cc:344] Connected to a master server at 127.20.103.126:39327
14:26:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.404037 21417 heartbeater.cc:461] Registering TS with master...
14:26:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.404666 21417 heartbeater.cc:507] Master 127.20.103.126:39327 requested a full tablet report, sending...
14:26:09.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.408486 20939 ts_manager.cc:194] Registered new tserver with Master: 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757)
14:26:09.427 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:09.428 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:09.428 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:09.428 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.428 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.428 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.428 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.428 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.429 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:09.429 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29680), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [45ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [104ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [104ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [104ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [242ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [242ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [242ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [242ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [323ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [502ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [502ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [502ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [503ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [842ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [842ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1462ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3003ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3421ms] refreshing cache from master, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3422ms] too many traces: truncated at 100 traces, deferred=Deferred@501728330(state=PENDING, result=null, callback=(continuation of Deferred@1395409271 after retry RPC after error@1545726983) -> (continuation of Deferred@1740398156 after retry RPC after error@1155138405) -> (continuation of Deferred@1967965552 after retry RPC after error@643718666) -> (continuation of Deferred@596978355 after retry RPC after error@926995599) -> (continuation of Deferred@607445074 after retry RPC after error@1884181712) -> (continuation of Deferred@2055481560 after retry RPC after error@1272016811) -> (continuation of Deferred@1222914291 after retry RPC after error@1242437099) -> (continuation of Deferred@295118490 after retry RPC after error@1367060276) -> (continuation of Deferred@955350592 after retry RPC after error@48928248) -> (continuation of Deferred@711053513 after retry RPC after error@644860094) -> (continuation of Deferred@366977357 after retry RPC after error@1129100123) -> (continuation of Deferred@1729090659 after retry RPC after error@1073596932) -> (continuation of Deferred@1472250239 after retry RPC after error@1907390135) -> (continuation of Deferred@1745160238 after retry RPC after error@972640960) -> (continuation of Deferred@1751365561 after retry RPC after error@437543372) -> (continuation of Deferred@1519406808 after retry RPC after error@697071640) -> (continuation of Deferred@1554504943 after retry RPC after error@1703206070) -> (continuation of Deferred@1035642960 after retry RPC after error@2008832839) -> (continuation of Deferred@354333179 after retry RPC after error@1455206018) -> (continuation of Deferred@1051489325 after retry RPC after error@727672540) -> (continuation of Deferred@1269734181 after retry RPC after error@2027283564) -> (continuation of Deferred@621144647 after retry RPC after error@1975255485) -> (continuation of Deferred@1257560988 after retry RPC after error@492154922) -> (continuation of Deferred@386410005 after retry RPC after error@44854432) -> (continuation of Deferred@1860726610 after retry RPC after error@1577862725) -> (continuation of Deferred@149089055 after retry RPC after error@1774866383) -> (continuation of Deferred@1156923227 after retry RPC after error@2021091310) -> (continuation of Deferred@1741869548 after retry RPC after error@1558007534) -> (continuation of Deferred@826256841 after retry RPC after error@1916068887), errback=(continuation of Deferred@1395409271 after retry RPC after error@1545726983) -> (continuation of Deferred@1740398156 after retry RPC after error@1155138405) -> (continuation of Deferred@1967965552 after retry RPC after error@643718666) -> (continuation of Deferred@596978355 after retry RPC after error@926995599) -> (continuation of Deferred@607445074 after retry RPC after error@1884181712) -> (continuation of Deferred@2055481560 after retry RPC after error@1272016811) -> (continuation of Deferred@1222914291 after retry RPC after error@1242437099) -> (continuation of Deferred@295118490 after retry RPC after error@1367060276) -> (continuation of Deferred@955350592 after retry RPC after error@48928248) -> (continuation of Deferred@711053513 after retry RPC after error@644860094) -> (continuation of Deferred@366977357 after retry RPC after error@1129100123) -> (continuation of Deferred@1729090659 after retry RPC after error@1073596932) -> (continuation of Deferred@1472250239 after retry RPC after error@1907390135) -> (continuation of Deferred@1745160238 after retry RPC after error@972640960) -> (continuation of Deferred@1751365561 after retry RPC after error@437543372) -> (continuation of Deferred@1519406808 after retry RPC after error@697071640) -> (continuation of Deferred@1554504943 after retry RPC after error@1703206070) -> (continuation of Deferred@1035642960 after retry RPC after error@2008832839) -> (continuation of Deferred@354333179 after retry RPC after error@1455206018) -> (continuation of Deferred@1051489325 after retry RPC after error@727672540) -> (continuation of Deferred@1269734181 after retry RPC after error@2027283564) -> (continuation of Deferred@621144647 after retry RPC after error@1975255485) -> (continuation of Deferred@1257560988 after retry RPC after error@492154922) -> (continuation of Deferred@386410005 after retry RPC after error@44854432) -> (continuation of Deferred@1860726610 after retry RPC after error@1577862725) -> (continuation of Deferred@149089055 after retry RPC after error@1774866383) -> (continuation of Deferred@1156923227 after retry RPC after error@2021091310) -> (continuation of Deferred@1741869548 after retry RPC after error@1558007534) -> (continuation of Deferred@826256841 after retry RPC after error@1916068887)))
14:26:09.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:09.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:09.430 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:09.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.431 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.431 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.431 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.431 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.431 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.431 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:09.506 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.506 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.507 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.507 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.507 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.585 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:09.586 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:09.586 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:09.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.586 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.586 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.587 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.587 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.587 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.587 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.587 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.587 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.587 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:09.626 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:09.626 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:09.626 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:09.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:09.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:09.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:09.628 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:09.651 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:09.652 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:09.652 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:09.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:09.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:09.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:09.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:09.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:09.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:09.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:09.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:09.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:09.652 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:09.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.709 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:09.709 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:09.709 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:09.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:09.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.710 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:09.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:09.710 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:09.710 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29938), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [10ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [33ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [33ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [59ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [88ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [88ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [88ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [142ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [261ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [262ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [983ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2620ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2623ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2880ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1457061394(state=PENDING, result=null, callback=(continuation of Deferred@702371346 after retry RPC after error@199518445) -> (continuation of Deferred@1914142489 after retry RPC after error@1672361767) -> (continuation of Deferred@536903814 after retry RPC after error@134948715) -> (continuation of Deferred@1093496516 after retry RPC after error@1403551433) -> (continuation of Deferred@2005454986 after retry RPC after error@644448623) -> (continuation of Deferred@202936360 after retry RPC after error@483850580) -> (continuation of Deferred@762013380 after retry RPC after error@1197734143) -> (continuation of Deferred@254982635 after retry RPC after error@604368128) -> (continuation of Deferred@1378804226 after retry RPC after error@181558456) -> (continuation of Deferred@271929832 after retry RPC after error@466862851) -> (continuation of Deferred@1044909193 after retry RPC after error@644329572) -> (continuation of Deferred@484904785 after retry RPC after error@430509077) -> (continuation of Deferred@1736140781 after retry RPC after error@2080641014) -> (continuation of Deferred@1480399520 after retry RPC after error@161836054) -> (continuation of Deferred@903689920 after retry RPC after error@1778050098) -> (continuation of Deferred@1495403447 after retry RPC after error@2068121945) -> (continuation of Deferred@661806023 after retry RPC after error@429387887) -> (continuation of Deferred@1344356185 after retry RPC after error@58584005) -> (continuation of Deferred@912536590 after retry RPC after error@282504741) -> (continuation of Deferred@1238667409 after retry RPC after error@630946221) -> (continuation of Deferred@843644244 after retry RPC after error@399170238) -> (continuation of Deferred@2054656206 after retry RPC after error@81774652) -> (continuation of Deferred@1896363950 after retry RPC after error@810945563) -> (continuation of Deferred@1994464063 after retry RPC after error@210084855) -> (continuation of Deferred@1006649486 after retry RPC after error@1018607041) -> (continuation of Deferred@1123051915 after retry RPC after error@1674305593) -> (continuation of Deferred@1567738110 after retry RPC after error@1423992364) -> (continuation of Deferred@362672394 after retry RPC after error@703271336), errback=(continuation of Deferred@702371346 after retry RPC after error@199518445) -> (continuation of Deferred@1914142489 after retry RPC after error@1672361767) -> (continuation of Deferred@536903814 after retry RPC after error@134948715) -> (continuation of Deferred@1093496516 after retry RPC after error@1403551433) -> (continuation of Deferred@2005454986 after retry RPC after error@644448623) -> (continuation of Deferred@202936360 after retry RPC after error@483850580) -> (continuation of Deferred@762013380 after retry RPC after error@1197734143) -> (continuation of Deferred@254982635 after retry RPC after error@604368128) -> (continuation of Deferred@1378804226 after retry RPC after error@181558456) -> (continuation of Deferred@271929832 after retry RPC after error@466862851) -> (continuation of Deferred@1044909193 after retry RPC after error@644329572) -> (continuation of Deferred@484904785 after retry RPC after error@430509077) -> (continuation of Deferred@1736140781 after retry RPC after error@2080641014) -> (continuation of Deferred@1480399520 after retry RPC after error@161836054) -> (continuation of Deferred@903689920 after retry RPC after error@1778050098) -> (continuation of Deferred@1495403447 after retry RPC after error@2068121945) -> (continuation of Deferred@661806023 after retry RPC after error@429387887) -> (continuation of Deferred@1344356185 after retry RPC after error@58584005) -> (continuation of Deferred@912536590 after retry RPC after error@282504741) -> (continuation of Deferred@1238667409 after retry RPC after error@630946221) -> (continuation of Deferred@843644244 after retry RPC after error@399170238) -> (continuation of Deferred@2054656206 after retry RPC after error@81774652) -> (continuation of Deferred@1896363950 after retry RPC after error@810945563) -> (continuation of Deferred@1994464063 after retry RPC after error@210084855) -> (continuation of Deferred@1006649486 after retry RPC after error@1018607041) -> (continuation of Deferred@1123051915 after retry RPC after error@1674305593) -> (continuation of Deferred@1567738110 after retry RPC after error@1423992364) -> (continuation of Deferred@362672394 after retry RPC after error@703271336)))
14:26:09.725 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:09.725 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:09.725 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:09.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:09.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:09.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:09.726 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:09.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:09.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:09.736 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:09.736 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:09.736 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:09.736 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:09.736 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:09.736 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:09.736 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:09.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:09.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:09.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:09.736 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.776669 21425 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.777206 21425 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.777616 21425 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:09.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.834937 21425 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:09.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.836333 21425 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.103.66
14:26:09.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.882710 21425 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.66:0
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data/info.pb
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.66
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.66
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/logs
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:09.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:09.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.884588 21425 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:09.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:09.886541 21425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:09.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.900311 21432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:09.981 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:09.981 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:09.981 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:09.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.981 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.981 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:09.981 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:09.981 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.981 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.982 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:09.982 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:10.051 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:10.051 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:10.051 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:10.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.053 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.053 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.053 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.053 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:10.106 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:10.106 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:10.106 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:10.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:10.146 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:10.147 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:10.147 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:10.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:10.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:10.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:10.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:10.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:10.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:10.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:10.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:10.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:10.148 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:10.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:10.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:10.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:10.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:10.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:10.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:10.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:10.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:10.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:10.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:10.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:10.228 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:10.228 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:10.240 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:10.240 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:10.240 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:10.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:10.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:10.242 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.242 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.242 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:10.242 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:10.291 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:10.292 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:10.292 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:10.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:10.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:10.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:10.293 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:10.293 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:10.293 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:10.293 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:10.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:10.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:10.293 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:10.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.391 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:10.391 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:10.391 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:10.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.393 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:10.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:10.394905 21416 heartbeater.cc:499] Master 127.20.103.125:34309 was elected leader, sending a full tablet report...
14:26:10.577 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:10.577 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:10.577 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:10.577 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.577 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:10.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:10.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:10.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:10.579 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:10.579 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:10.579 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:10.669 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:10.669 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:10.670 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:10.670 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:10.670 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:10.670 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:10.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:10.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:10.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:10.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:10.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:10.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:10.671 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:10.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.766 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:10.766 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:10.766 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:10.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.767 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.767 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.768 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:10.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.846 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:10.846 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:10.846 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:10.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:10.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:10.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:10.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:10.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:10.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:10.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:10.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:10.979 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.979 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.979 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:10.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.008 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:11.126 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:11.126 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:11.126 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:11.127 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.127 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.127 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.127 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.127 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:11.127 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:11.127 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.127 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:11.127 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.128 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:11.128 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.128 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.128 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.128 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.128 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.128 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.128 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.128 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.128 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.128 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:11.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:11.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:11.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:11.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.150 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:11.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.219 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:11.220 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:11.220 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:11.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.220 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.220 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.220 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:11.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.366 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:11.366 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:11.366 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:11.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.368 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.368 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:11.584 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:11.584 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:11.584 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:11.585 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.585 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.585 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:11.585 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:11.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:11.585 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:11.608 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:11.608 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:11.608 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:11.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:11.609 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.609 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.609 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:11.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:11.613 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:11.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.708 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:26:11.709 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:26:11.712 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
14:26:11.712 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:11.713 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
14:26:11.714 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
14:26:11.714 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:26:11.714 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
14:26:11.715 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:26:11.715 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
14:26:11.715 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:26:11.716 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:26:11.716 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:11.716 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:11.719 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
14:26:11.726 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:26:11.727 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:26:11.728 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
14:26:11.728 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
14:26:11.728 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:11.728 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
14:26:11.729 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
14:26:11.730 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
14:26:11.731 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:26:11.732 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:26:11.732 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:26:11.735 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61357d68
14:26:11.735 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:11.736 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:11.736 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:26:11.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32f65a06
14:26:11.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:11.737 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:11.737 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:26:11.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@677b1017
14:26:11.741 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
14:26:11.741 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:11.744 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16474013
14:26:11.744 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
14:26:11.744 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:26:11.745 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:11.746 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
14:26:11.747 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
14:26:11.749 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:11.758 [INFO - Thread-57] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:11.760 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state TERMINATED
14:26:11.761 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state TERMINATED
14:26:11.762 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state TERMINATED
14:26:11.763 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:11.764 [INFO - Thread-57] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:11.765 [INFO - Thread-57] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:11.768 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:26:11.769 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:26:11.773 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
14:26:11.773 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
14:26:11.778 [DEBUG - Thread-57] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:11.779 [INFO - Thread-57] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:11.781 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5acfa8b8
14:26:11.782 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:11.782 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:11.782 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:26:11.782 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
14:26:11.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
14:26:11.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
14:26:11.791 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:11.791 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:11.791 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:11.791 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@30edf9e1
14:26:11.791 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:11.791 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.791 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.791 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.792 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.792 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.792 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.792 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.792 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.792 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.792 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:11.794 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:11.796 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:26:11.814 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.820 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
14:26:11.824 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@792c6b33
14:26:11.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.848 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:11.306157 21431 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 21425
14:26:11.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:11.851907 21425 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.951s	user 0.645s	sys 1.235s
14:26:11.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:11.852221 21425 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.951s	user 0.645s	sys 1.235s
14:26:11.852 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bde6bde
14:26:11.853 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:11.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:09.902024 21433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:11.855393 21435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:11.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:11.856477 21434 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1955 milliseconds
14:26:11.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:11.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.858490 21425 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:11.861 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:11.861 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:11.862 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:11.862 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:11.863 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:11.863 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.864 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.864 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.865 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.866 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.866 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.866 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.867300 21425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:11.872 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.872 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.872 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.873 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.877 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.879513 21425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:11.882 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.886 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:11.886 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:11.886 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:11.886 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:11.887 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.887 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.887 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:11.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:11.887 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:11.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.887399 21425 hybrid_clock.cc:648] HybridClock initialized: now 1779114371887325 us; error 76 us; skew 500 ppm
14:26:11.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.888367 21425 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:11.890 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.890 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.893 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.893 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.894 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.894 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.895 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.896 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.896 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.896 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:11.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.897048 21425 webserver.cc:533] Webserver started at http://127.20.103.66:37861/ using document root <none> and password file <none>
14:26:11.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.897 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.897 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.898 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.898 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.898367 21425 fs_manager.cc:362] Metadata directory not provided
14:26:11.898 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.898797 21425 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:11.899 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.899 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.899 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.899 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.899468 21425 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:11.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.900 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:11.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.901 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.901 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.901 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.901 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.901 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.902 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:11.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.902 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.902 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.902 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.902 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.902 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.902 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:11.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.903 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.904 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.904 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.904 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.904 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.904 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.904 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.904 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.905818 21425 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data/instance:
14:26:11.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:11.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:11 on dist-test-slave-1n46"
14:26:11.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.907435 21425 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal/instance:
14:26:11.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:11.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:11 on dist-test-slave-1n46"
14:26:11.908 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.910 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.910 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.910 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.911 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.911 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.911 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.913 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.915 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.916 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:11.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.917173 21425 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
14:26:11.918 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.918 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.922 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.922 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.923 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.925235 21486 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:11.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.926457 21425 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
14:26:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.926836 21425 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal
14:26:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:11 on dist-test-slave-1n46"
14:26:11.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.927 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:11.927258 21425 fs_report.cc:389] FS layout report
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data/data
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:11.928 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.928 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.928 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.929 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.930 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.934 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.939 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.940 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.949 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.949 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.949 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.950 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.950 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.950 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.950 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.954 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.954 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.955 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.955 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.957 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.958 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.966 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.967 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.968 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.968 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.969 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.970 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.970 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.974 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:11.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.974 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:11.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.975 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.975 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.975 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.976 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.982 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.982 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.982 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.982 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.982 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.983 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:11.983 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.984 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.994 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.994 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.995 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.995 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.995 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.995 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.995 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:11.995 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:11.996 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:11.996 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:11.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:11.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.996 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:11.996 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:11.997 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:11.997 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:11.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.998 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.998 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:11.998 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:11.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:11.998 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.998 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.998 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:11.998 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.002 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.003 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.003 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.003 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.003 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.003 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.003 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.003 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.003 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.008080 21425 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:12.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.009 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.009856 21425 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:12.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.010381 21425 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:12.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.013598 21425 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:12.014 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.014 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.014 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.015 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.016 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.016 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.016 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.016 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.016 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.016 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.017 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.019276 21425 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:12.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.019546 21425 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:12.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.019861 21425 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:12.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.020083 21425 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:12.022 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.022 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.022 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.022 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.022 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.023 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.023 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.023 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.028 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.028 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.028 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.028 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.028 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.028 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.028 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.028 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.028 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.034 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.034 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.035 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.035 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.035 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.035 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.036 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.036 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.035 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.037 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.037 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.037 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.037 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.037 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.037 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.043 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.043 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.043 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.043 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.043 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.043 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.043 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.044 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.058 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.058 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.058 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.058 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.058 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.058 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.059 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.060 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.060 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.063 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:12.063 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:12.063 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:12.063 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.063 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.063 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.063 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.063 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.064 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.064 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:12.074 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.074 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.074 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.075 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.095 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.095 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.095 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.095 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.143 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.143 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.143 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.143 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.144 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.175 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.175 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.175 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.176 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.176 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.176 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.176 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.176 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.177 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.177 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.200 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:12.201 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:12.201 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:12.201 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:12.201 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:12.201 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:12.201 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:12.201 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:12.201 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:12.201 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:12.201 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:12.201 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:12.202 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:12.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.202566 21425 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.66:35167
14:26:12.202 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.203 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.202811 21610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.66:35167 every 8 connection(s)
14:26:12.203 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.203 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.203 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.203 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.203 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.203 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.203 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.205 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:12.205 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:12.205 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:12.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.206 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.206 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.206 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:12.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.205706 21425 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/data/info.pb
14:26:12.216 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.216 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.217 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.217 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.217 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.217 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.217 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.217 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.217 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.218 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.214210 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 21425
14:26:12.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.214902 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-1/wal/instance
14:26:12.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.236 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.236 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.236 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.236 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.236 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.236 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.236 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.236 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.245857 20893 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/logs
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data/info.pb
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.67:0
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.67
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.67
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:12.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:12.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:12.255 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:12.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.256 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:12.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:12.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:12.256 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.257875 21612 heartbeater.cc:344] Connected to a master server at 127.20.103.125:34309
14:26:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.258411 21612 heartbeater.cc:461] Registering TS with master...
14:26:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.259187 21611 heartbeater.cc:344] Connected to a master server at 127.20.103.124:41795
14:26:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.259524 21611 heartbeater.cc:461] Registering TS with master...
14:26:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.259804 21612 heartbeater.cc:507] Master 127.20.103.125:34309 requested a full tablet report, sending...
14:26:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.260550 21611 heartbeater.cc:507] Master 127.20.103.124:41795 requested a full tablet report, sending...
14:26:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.261667 21613 heartbeater.cc:344] Connected to a master server at 127.20.103.126:39327
14:26:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.262048 21613 heartbeater.cc:461] Registering TS with master...
14:26:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.262457 21014 ts_manager.cc:194] Registered new tserver with Master: 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:12.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.262775 21613 heartbeater.cc:507] Master 127.20.103.126:39327 requested a full tablet report, sending...
14:26:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.264096 21014 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.103.66:52235
14:26:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.265288 21097 ts_manager.cc:194] Registered new tserver with Master: 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.266337 20939 ts_manager.cc:194] Registered new tserver with Master: 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:12.268 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.268 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.268 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.268 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.271 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:12.271 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:12.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.271 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:12.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:12.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:12.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:12.271 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:12.277 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.277 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.277 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.277 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.277 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.277 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.278 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.278 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.291 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:12.291 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:12.291 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:12.291 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.291 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.291 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.291 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.291 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.291 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.291 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.291 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.291 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.291 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:12.329 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:12.329 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:12.329 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:12.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.330 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.330 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.330 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.330 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.330 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:12.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:12.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:12.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:12.577 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:12.578 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.578 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.578 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:12.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:12.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:12.615 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.615 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.616 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.616 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.617 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.623670 21621 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:12.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.624265 21621 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:12.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.624986 21621 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:12.642 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.643 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.643 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.643 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.643 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.643 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.643 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.648 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.648 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.648 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.648 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.648 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.648 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.648 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.648 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.648 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.649 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.649 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.654 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.654 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.654 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.655 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.655 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.669445 21621 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:12.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.670439 21621 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.103.67
14:26:12.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.698 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.713867 21621 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.103.84:34505
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.103.67:0
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data/info.pb
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.103.67
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.103.126:39327,127.20.103.125:34309,127.20.103.124:41795
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.103.67
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/logs
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:12.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.716212 21621 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:12.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:12.717978 21621 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:12.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.732306 21628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:12.783 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:12.783 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:12.783 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:12.784 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.784 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.784 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:12.784 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.784 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.785 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:12.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.785 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.785 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:12.785 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:12.828 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.828 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.828 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.830 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.830 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.830 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.830 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.830 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.830 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.830 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:12.869 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:12.869 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:12.869 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:12.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:12.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:12.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:12.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:12.943 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.943 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.943 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.943 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.943 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.943 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.943 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.943 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.943 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.944 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.944 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.944 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:12.974 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:12.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:12.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:12.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:12.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:12.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:12.975 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:13.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:13.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:13.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:13.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.005 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:13.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:13.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:13.091 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:13.091 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.091 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.091 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.091 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.092 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:13.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:13.092 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.092 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.092 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:13.092 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:13.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:13.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:13.097 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:13.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.097 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.097 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.098 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:13.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.196 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.234 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:13.235 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:13.235 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:13.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.236 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.236 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.236 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.236 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:13.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:13.269762 21612 heartbeater.cc:499] Master 127.20.103.125:34309 was elected leader, sending a full tablet report...
14:26:13.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.488 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:13.488 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:13.488 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:13.488 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:13.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:13.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:13.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:13.488 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:13.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:13.488 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:13.490 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:13.490 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:13.490 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:13.512 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:13.512 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:13.512 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:13.512 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:13.512 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:13.512 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:13.513 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:13.513 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:13.513 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:13.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:13.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:13.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:13.513 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:13.563 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:13.563 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:13.563 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:13.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.564 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.564 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.564 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:13.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:13.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:13.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:13.686 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:13.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:13.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:13.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:13.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:13.687 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:13.687 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:13.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:13.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:13.688 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:13.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.789 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:13.789 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:13.789 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:13.790 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.790 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.790 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.790 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.791 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.791 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.791 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.791 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.791 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:13.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.835 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:13.835 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:13.835 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:13.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.836 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:13.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.836 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.836 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:13.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.836 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.836 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:13.836 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:13.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:13.876 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:13.877 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:13.877 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:13.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.878 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:13.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:13.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:13.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:13.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.898 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.898 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:13.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:13.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:13.898 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:14.020 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:14.020 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:14.020 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:14.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.021 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:14.088 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:14.088 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:14.088 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:14.089 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.089 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.090 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.090 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.090 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.090 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.090 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.090 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:14.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:12.732942 21629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:14.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:14.116889 21621 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.386s	user 0.446s	sys 0.898s
14:26:14.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:14.117201 21621 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.386s	user 0.446s	sys 0.898s
14:26:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.132568 21621 server_base.cc:1061] running on GCE node
14:26:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:14.132982 21634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.134460 21621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:14.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.136807 21621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:14.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.138263 21621 hybrid_clock.cc:648] HybridClock initialized: now 1779114374138225 us; error 31 us; skew 500 ppm
14:26:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.139153 21621 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:14.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.147040 21621 webserver.cc:533] Webserver started at http://127.20.103.67:45873/ using document root <none> and password file <none>
14:26:14.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.148116 21621 fs_manager.cc:362] Metadata directory not provided
14:26:14.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.148393 21621 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.148909 21621 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:14.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.154054 21621 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data/instance:
14:26:14.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:14.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:14 on dist-test-slave-1n46"
14:26:14.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.155359 21621 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal/instance:
14:26:14.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:14.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:14 on dist-test-slave-1n46"
14:26:14.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.163424 21621 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
14:26:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.169920 21639 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:14.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.171188 21621 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.171626 21621 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:14 on dist-test-slave-1n46"
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.172112 21621 fs_report.cc:389] FS layout report
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data/data
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:14.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.263012 21621 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:14.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.264670 21621 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.265067 21621 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:14.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.268018 21621 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:14.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.272751 21621 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:14.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.273000 21621 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:14.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.273324 21621 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:14.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.273520 21621 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:14.274 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:14.274 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:14.275 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:14.275 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.275 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.275 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.275 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.275 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.275 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.275 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:14.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.437006 21621 rpc_server.cc:307] RPC server started. Bound to: 127.20.103.67:35767
14:26:14.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.437177 21752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.103.67:35767 every 8 connection(s)
14:26:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.439713 21621 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/data/info.pb
14:26:14.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.441916 20893 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 21621
14:26:14.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.442413 20893 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster15244035427960844955/ts-2/wal/instance
14:26:14.465 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:14.466 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:14.466 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:14.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.466 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.466 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.466 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.466 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:14.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.492955 21757 heartbeater.cc:344] Connected to a master server at 127.20.103.126:39327
14:26:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.493410 21757 heartbeater.cc:461] Registering TS with master...
14:26:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.494264 21753 heartbeater.cc:344] Connected to a master server at 127.20.103.124:41795
14:26:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.494611 21753 heartbeater.cc:461] Registering TS with master...
14:26:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.494716 21757 heartbeater.cc:507] Master 127.20.103.126:39327 requested a full tablet report, sending...
14:26:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.495510 21753 heartbeater.cc:507] Master 127.20.103.124:41795 requested a full tablet report, sending...
14:26:14.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.497741 21097 ts_manager.cc:194] Registered new tserver with Master: 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:14.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.497699 20939 ts_manager.cc:194] Registered new tserver with Master: 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:14.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.499094 21754 heartbeater.cc:344] Connected to a master server at 127.20.103.125:34309
14:26:14.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.499413 21754 heartbeater.cc:461] Registering TS with master...
14:26:14.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.500254 21754 heartbeater.cc:507] Master 127.20.103.125:34309 requested a full tablet report, sending...
14:26:14.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.502228 21014 ts_manager.cc:194] Registered new tserver with Master: 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:14.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.503383 21014 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.103.67:50031
14:26:14.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.511970 20893 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:26:14.523 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:26:14.524 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:26:14.524 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.20.103.126"
      port: 39327
    }
    bound_http_address {
      host: "127.20.103.126"
      port: 33015
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.20.103.125"
      port: 34309
    }
    bound_http_address {
      host: "127.20.103.125"
      port: 34285
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.20.103.124"
      port: 41795
    }
    bound_http_address {
      host: "127.20.103.124"
      port: 44711
    }
  }
}

14:26:14.524 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:26:14.525 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.20.103.65"
      port: 40757
    }
    bound_http_address {
      host: "127.20.103.65"
      port: 46355
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.20.103.66"
      port: 35167
    }
    bound_http_address {
      host: "127.20.103.66"
      port: 37861
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.20.103.67"
      port: 35767
    }
    bound_http_address {
      host: "127.20.103.67"
      port: 45873
    }
  }
}

14:26:14.525 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:26:14.527 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:14.528 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:14.528 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:14.529 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:14.529 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.148.62:34807(127.19.148.62:34807)] Successfully connected to peer
14:26:14.529 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.148.60:37365(127.19.148.60:37365)] Successfully connected to peer
14:26:14.531 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.148.61:37523(127.19.148.61:37523)] Successfully connected to peer
14:26:14.534 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.62
14:26:14.534 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.61
14:26:14.544 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:14.547 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.60
14:26:14.547 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xca89caf3, L:/127.0.0.1:44220 - R:/127.19.148.62:34807] using SASL/PLAIN
14:26:14.553 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:14.554 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:14.556 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4aaac99e, L:/127.0.0.1:34696 - R:/127.19.148.60:37365] using SASL/PLAIN
14:26:14.558 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1bfa5042, L:/127.0.0.1:40688 - R:/127.19.148.61:37523] using SASL/PLAIN
14:26:14.561 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:14.562 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: OK, [32ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: OK, deferred=null) after lookup
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.564265 20303 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34696:
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:14.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:14.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:26:14.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:14.569067 20303 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:26:14.603 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:14.603 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:14.603 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:14.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.603 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.603 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.603 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.604 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:14.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.604 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:14.604 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:14.604 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:14.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28702), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [78ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [79ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [81ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [205ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [209ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [212ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [212ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [276ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [278ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [324ms] refreshing cache from master, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [324ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [325ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [420ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [761ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [921ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [922ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1203ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1364ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5121ms] too many traces: truncated at 100 traces, deferred=Deferred@544956271(state=PENDING, result=null, callback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810), errback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810)))
14:26:14.605 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.605 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.605 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.605 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:14.606 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:26:14.606 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28702), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [78ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [79ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [81ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [205ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [209ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [212ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [212ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [276ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [278ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [324ms] refreshing cache from master, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [324ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [325ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [420ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [761ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [921ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [922ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1203ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1364ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5121ms] too many traces: truncated at 100 traces, deferred=Deferred@544956271(state=PENDING, result=null, callback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810), errback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.61:42317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:14.606 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
14:26:14.608 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
14:26:14.610 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28702), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [78ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [79ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [81ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [205ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [209ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [212ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [212ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [276ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [278ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [278ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [324ms] refreshing cache from master, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [324ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [325ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [325ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [420ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [761ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [921ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [922ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [922ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1203ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1364ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5121ms] too many traces: truncated at 100 traces, deferred=Deferred@544956271(state=PENDING, result=null, callback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810), errback=(continuation of Deferred@1359180566 after retry RPC after error@1040464875) -> (continuation of Deferred@509862572 after retry RPC after error@1687766568) -> (continuation of Deferred@776475246 after retry RPC after error@822914863) -> (continuation of Deferred@813387040 after retry RPC after error@511571201) -> (continuation of Deferred@1892175810 after retry RPC after error@610919203) -> (continuation of Deferred@1309780163 after retry RPC after error@1060477437) -> (continuation of Deferred@229734278 after retry RPC after error@1714093544) -> (continuation of Deferred@624821854 after retry RPC after error@911710581) -> (continuation of Deferred@819778942 after retry RPC after error@27835184) -> (continuation of Deferred@1425097133 after retry RPC after error@1592256119) -> (continuation of Deferred@147238896 after retry RPC after error@1291056355) -> (continuation of Deferred@315701497 after retry RPC after error@1944367242) -> (continuation of Deferred@1323317289 after retry RPC after error@501713402) -> (continuation of Deferred@107637839 after retry RPC after error@1356659944) -> (continuation of Deferred@531802026 after retry RPC after error@1044076031) -> (continuation of Deferred@1810255459 after retry RPC after error@1550505035) -> (continuation of Deferred@1450157979 after retry RPC after error@840926212) -> (continuation of Deferred@1800618354 after retry RPC after error@1636899039) -> (continuation of Deferred@1248405513 after retry RPC after error@77118180) -> (continuation of Deferred@1974543316 after retry RPC after error@479169117) -> (continuation of Deferred@530960549 after retry RPC after error@1588270639) -> (continuation of Deferred@578298285 after retry RPC after error@1111853789) -> (continuation of Deferred@1943296712 after retry RPC after error@1967665395) -> (continuation of Deferred@375259838 after retry RPC after error@2015588810)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.61:42317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:14.611 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:14.611 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
14:26:14.611 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
14:26:14.611 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:26:14.626 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:14.626 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:14.626 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:14.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:14.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:14.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:14.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:14.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:14.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:14.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:14.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:14.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:14.628 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:14.657 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:14.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.724049 20818 tablet_service.cc:1511] Processing CreateTablet for tablet 394fedcdf5784f7f8b123aa3e85deaaa (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:14.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.725337 20815 tablet_service.cc:1511] Processing CreateTablet for tablet e3a4162415154ed8ba26ea64fa8f8161 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:14.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.724774 20816 tablet_service.cc:1511] Processing CreateTablet for tablet 4652257de6734e049df6608b64d5e2b1 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:14.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.726531 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fedcdf5784f7f8b123aa3e85deaaa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.727293 20816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4652257de6734e049df6608b64d5e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.727859 20817 tablet_service.cc:1511] Processing CreateTablet for tablet ad4d7093598a433b8ed42c0520e061c7 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:14.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.731268 20815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4162415154ed8ba26ea64fa8f8161. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.732622 20817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4d7093598a433b8ed42c0520e061c7. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.734174 20814 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5dd44151694c89a880404d0f161d64 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:14.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.735316 20814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5dd44151694c89a880404d0f161d64. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.740231 20813 tablet_service.cc:1511] Processing CreateTablet for tablet ed72fc8fc2a449d0b2c8519ac4872540 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:14.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.741189 20813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed72fc8fc2a449d0b2c8519ac4872540. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.744144 20482 tablet_service.cc:1511] Processing CreateTablet for tablet 394fedcdf5784f7f8b123aa3e85deaaa (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:14.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.747004 20481 tablet_service.cc:1511] Processing CreateTablet for tablet ad4d7093598a433b8ed42c0520e061c7 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:14.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.748167 20480 tablet_service.cc:1511] Processing CreateTablet for tablet 4652257de6734e049df6608b64d5e2b1 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:14.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.750726 20479 tablet_service.cc:1511] Processing CreateTablet for tablet e3a4162415154ed8ba26ea64fa8f8161 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.752760 20478 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5dd44151694c89a880404d0f161d64 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:14.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.755417 20477 tablet_service.cc:1511] Processing CreateTablet for tablet ed72fc8fc2a449d0b2c8519ac4872540 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:14.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.759943 20481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4d7093598a433b8ed42c0520e061c7. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.761503 20480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4652257de6734e049df6608b64d5e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.765146 20478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5dd44151694c89a880404d0f161d64. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.766 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:14.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.766655 20477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed72fc8fc2a449d0b2c8519ac4872540. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.767 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:14.767 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:14.767 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.767 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.767 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:14.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:14.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:14.768 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:14.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.768638 20479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4162415154ed8ba26ea64fa8f8161. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.774 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:14.774 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:14.774 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:14.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:14.776 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:14.776 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:14.776 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:14.776 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.776 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.776 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:14.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:14.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.779 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:14.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:14.779 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:14.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:14.780 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:14.781 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28737), Traces: [0ms] refreshing cache from master, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [159ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [187ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [189ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [190ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [206ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [241ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [282ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [682ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1683ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2441ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3100ms] too many traces: truncated at 100 traces, deferred=Deferred@1261550834(state=PENDING, result=null, callback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283), errback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283)))
14:26:14.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.782802 20482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fedcdf5784f7f8b123aa3e85deaaa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.786 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:26:14.786 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28737), Traces: [0ms] refreshing cache from master, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [159ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [187ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [189ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [190ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [206ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [241ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [282ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [682ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1683ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2441ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3100ms] too many traces: truncated at 100 traces, deferred=Deferred@1261550834(state=PENDING, result=null, callback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283), errback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:14.787 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
14:26:14.788 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
14:26:14.790 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28737), Traces: [0ms] refreshing cache from master, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [159ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [160ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [185ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [187ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [189ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [190ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [206ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [222ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [241ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [282ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [562ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [682ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1683ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2441ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3100ms] too many traces: truncated at 100 traces, deferred=Deferred@1261550834(state=PENDING, result=null, callback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283), errback=(continuation of Deferred@393548115 after retry RPC after error@453150734) -> (continuation of Deferred@1252329512 after retry RPC after error@204864418) -> (continuation of Deferred@871730430 after retry RPC after error@1010315382) -> (continuation of Deferred@1589545873 after retry RPC after error@2113245967) -> (continuation of Deferred@1660449331 after retry RPC after error@524178842) -> (continuation of Deferred@905357295 after retry RPC after error@1682585525) -> (continuation of Deferred@1157806309 after retry RPC after error@687712090) -> (continuation of Deferred@674542709 after retry RPC after error@502716761) -> (continuation of Deferred@1298370450 after retry RPC after error@140588563) -> (continuation of Deferred@91991158 after retry RPC after error@787251601) -> (continuation of Deferred@2141361345 after retry RPC after error@2129851528) -> (continuation of Deferred@640876348 after retry RPC after error@1813512802) -> (continuation of Deferred@133666748 after retry RPC after error@1850238334) -> (continuation of Deferred@1605549204 after retry RPC after error@1930800658) -> (continuation of Deferred@1214549435 after retry RPC after error@1697276508) -> (continuation of Deferred@800470129 after retry RPC after error@1905093291) -> (continuation of Deferred@493369460 after retry RPC after error@736530695) -> (continuation of Deferred@896351670 after retry RPC after error@800047490) -> (continuation of Deferred@1943594907 after retry RPC after error@1823026766) -> (continuation of Deferred@821374688 after retry RPC after error@1636256429) -> (continuation of Deferred@1440193849 after retry RPC after error@1881735827) -> (continuation of Deferred@1773318232 after retry RPC after error@842751457) -> (continuation of Deferred@1533812938 after retry RPC after error@1676254382) -> (continuation of Deferred@530960635 after retry RPC after error@1998148283)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:14.791 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
14:26:14.791 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
14:26:14.791 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.784700 20623 tablet_service.cc:1511] Processing CreateTablet for tablet 4652257de6734e049df6608b64d5e2b1 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.789535 20623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4652257de6734e049df6608b64d5e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.792273 20624 tablet_service.cc:1511] Processing CreateTablet for tablet ad4d7093598a433b8ed42c0520e061c7 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.793315 20624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4d7093598a433b8ed42c0520e061c7. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.795902 20622 tablet_service.cc:1511] Processing CreateTablet for tablet e3a4162415154ed8ba26ea64fa8f8161 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:14.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.796864 20622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4162415154ed8ba26ea64fa8f8161. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.800640 20621 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5dd44151694c89a880404d0f161d64 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:14.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.801739 20621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5dd44151694c89a880404d0f161d64. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.808122 20620 tablet_service.cc:1511] Processing CreateTablet for tablet ed72fc8fc2a449d0b2c8519ac4872540 (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:14.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.810170 20625 tablet_service.cc:1511] Processing CreateTablet for tablet 394fedcdf5784f7f8b123aa3e85deaaa (DEFAULT_TABLE table=replication_test_table [id=db2c79c58ac641798f33a8d3e39ada67]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:14.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.811292 20620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed72fc8fc2a449d0b2c8519ac4872540. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.813222 20625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fedcdf5784f7f8b123aa3e85deaaa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:14.824 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:14.824 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:14.824 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:14.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:14.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:14.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:14.825 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:14.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:14.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.884167 21786 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:14.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.910929 21786 tablet_bootstrap.cc:654] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:14.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.915257 21786 log.cc:826] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: Log is configured to *not* fsync() on all Append() calls
14:26:14.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.943852 21788 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:14.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.948144 21787 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:14.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.955013 21786 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:14.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.955801 21786 ts_tablet_manager.cc:1403] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.013s
14:26:14.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.964813 21787 tablet_bootstrap.cc:654] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:14.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.967442 21787 log.cc:826] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Log is configured to *not* fsync() on all Append() calls
14:26:14.978 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:14.978 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:14.978 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:14.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:14.979 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:14.979 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:14.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:14.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:14.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:14.979 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:14.979 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:14.979 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:14.979 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:14.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.978454 21788 tablet_bootstrap.cc:654] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:14.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.981256 21788 log.cc:826] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Log is configured to *not* fsync() on all Append() calls
14:26:14.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.987514 21787 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:14.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:14.988189 21787 ts_tablet_manager.cc:1403] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.009s
14:26:15.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.003708 21788 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.004238 21788 ts_tablet_manager.cc:1403] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
14:26:15.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.021713 21787 raft_consensus.cc:359] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.022718 21787 raft_consensus.cc:385] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.023097 21787 raft_consensus.cc:740] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.024376 21787 consensus_queue.cc:260] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.035089 21787 ts_tablet_manager.cc:1434] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.046s	user 0.020s	sys 0.011s
14:26:15.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.036875 21786 raft_consensus.cc:359] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.037777 21786 raft_consensus.cc:385] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.038822 21787 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:15.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.038087 21786 raft_consensus.cc:740] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.042364 21786 consensus_queue.cc:260] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.055382 21786 ts_tablet_manager.cc:1434] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.098s	user 0.027s	sys 0.011s
14:26:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.056591 21786 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:15.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.062577 21786 tablet_bootstrap.cc:654] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:15.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.062444 21788 raft_consensus.cc:359] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.064616 21788 raft_consensus.cc:385] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.064906 21788 raft_consensus.cc:740] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.065 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:15.065 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:15.066 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:15.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.066 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.066 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.072108 21788 consensus_queue.cc:260] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.073921 21786 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:15.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.074339 21786 ts_tablet_manager.cc:1403] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
14:26:15.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.074700 21787 tablet_bootstrap.cc:654] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.077061 21786 raft_consensus.cc:359] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.077592 21786 raft_consensus.cc:385] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.077845 21786 raft_consensus.cc:740] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.078264 21788 ts_tablet_manager.cc:1434] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.074s	user 0.028s	sys 0.004s
14:26:15.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.078404 21786 consensus_queue.cc:260] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.080765 21786 ts_tablet_manager.cc:1434] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
14:26:15.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.081696 21786 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:15.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.082964 21788 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:15.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.087452 21786 tablet_bootstrap.cc:654] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:15.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.094122 21788 tablet_bootstrap.cc:654] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:15.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.097199 21792 raft_consensus.cc:493] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.097827 21792 raft_consensus.cc:515] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.099444 21786 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:15.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.100023 21786 ts_tablet_manager.cc:1403] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
14:26:15.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.103340 21786 raft_consensus.cc:359] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.104069 21786 raft_consensus.cc:385] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.104327 21786 raft_consensus.cc:740] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.105005 21786 consensus_queue.cc:260] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.107450 21786 ts_tablet_manager.cc:1434] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
14:26:15.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.108330 21786 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.114377 21788 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.114848 21788 ts_tablet_manager.cc:1403] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.008s
14:26:15.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.116489 21786 tablet_bootstrap.cc:654] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:15.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.117457 21788 raft_consensus.cc:359] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.118067 21788 raft_consensus.cc:385] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.118327 21788 raft_consensus.cc:740] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.119024 21788 consensus_queue.cc:260] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.129683 21788 ts_tablet_manager.cc:1434] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
14:26:15.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.134968 21788 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:15.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.140303 21792 leader_election.cc:290] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.146482 20890 tablet.cc:2404] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.148465 21788 tablet_bootstrap.cc:654] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:15.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.157703 21793 raft_consensus.cc:493] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.158347 21793 raft_consensus.cc:515] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.162508 21793 leader_election.cc:290] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:26:15.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.187477 20697 tablet.cc:2404] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:15.196 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.196277 21795 raft_consensus.cc:493] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.197121 21795 raft_consensus.cc:515] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.212956 21801 raft_consensus.cc:493] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.213663 21795 leader_election.cc:290] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.213383 21801 raft_consensus.cc:515] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.215464 21801 leader_election.cc:290] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.240 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.241 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.241 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.242 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.242 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.242 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29103), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [6ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [90ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [90ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [128ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [129ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [129ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [223ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [283ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [802ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3003ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3003ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4261ms] refreshing cache from master, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4262ms] too many traces: truncated at 100 traces, deferred=Deferred@1180881090(state=PENDING, result=null, callback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662), errback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662)))
14:26:15.243 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.244 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.244 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.244 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29103), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [6ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [90ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [90ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [128ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [129ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [129ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [223ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [283ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [802ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3003ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3003ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4261ms] refreshing cache from master, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4262ms] too many traces: truncated at 100 traces, deferred=Deferred@1180881090(state=PENDING, result=null, callback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662), errback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29103), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [6ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [90ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [90ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [128ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [129ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [129ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [223ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [283ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [802ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3003ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3003ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4261ms] refreshing cache from master, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4262ms] too many traces: truncated at 100 traces, deferred=Deferred@1180881090(state=PENDING, result=null, callback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662), errback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:15.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.246 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.246 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.246 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.246 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.246 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.246 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.246 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.251 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29103), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [6ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [90ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [90ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [128ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [129ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [129ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [223ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [283ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [802ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3003ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3003ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4261ms] refreshing cache from master, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4262ms] too many traces: truncated at 100 traces, deferred=Deferred@1180881090(state=PENDING, result=null, callback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662), errback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29103), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [4ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [6ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [64ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [87ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [90ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [90ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [127ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [128ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [129ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [129ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [162ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [162ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [223ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [283ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [463ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [463ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [802ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1183ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3001ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [3002ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [3003ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3003ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [4261ms] refreshing cache from master, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [4262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [4262ms] too many traces: truncated at 100 traces, deferred=Deferred@1180881090(state=PENDING, result=null, callback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662), errback=(continuation of Deferred@1533524176 after retry RPC after error@1117588375) -> (continuation of Deferred@115539414 after retry RPC after error@1448532232) -> (continuation of Deferred@806439466 after retry RPC after error@444214796) -> (continuation of Deferred@191327448 after retry RPC after error@1796827685) -> (continuation of Deferred@1365454198 after retry RPC after error@446853912) -> (continuation of Deferred@714333496 after retry RPC after error@184275469) -> (continuation of Deferred@1111180985 after retry RPC after error@1258870613) -> (continuation of Deferred@2143725841 after retry RPC after error@729380702) -> (continuation of Deferred@862970374 after retry RPC after error@1045444929) -> (continuation of Deferred@1955893691 after retry RPC after error@339205104) -> (continuation of Deferred@1485075618 after retry RPC after error@1738654914) -> (continuation of Deferred@929601732 after retry RPC after error@489307522) -> (continuation of Deferred@1727036385 after retry RPC after error@253637673) -> (continuation of Deferred@2084778934 after retry RPC after error@818534289) -> (continuation of Deferred@1434684698 after retry RPC after error@725763327) -> (continuation of Deferred@1324948642 after retry RPC after error@821182387) -> (continuation of Deferred@2035322858 after retry RPC after error@1074551171) -> (continuation of Deferred@1184252204 after retry RPC after error@1731785194) -> (continuation of Deferred@451546424 after retry RPC after error@940089255) -> (continuation of Deferred@1289959083 after retry RPC after error@1827944828) -> (continuation of Deferred@649951767 after retry RPC after error@1521761472) -> (continuation of Deferred@255266643 after retry RPC after error@1120270352) -> (continuation of Deferred@266690461 after retry RPC after error@1951150237) -> (continuation of Deferred@1127675088 after retry RPC after error@777949662)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.189:37257
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:15.252 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:15.252 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
14:26:15.252 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
14:26:15.253 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
14:26:15.253 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
14:26:15.253 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
14:26:15.253 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
14:26:15.253 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
14:26:15.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.258842 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.259696 20502 raft_consensus.cc:2468] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 931d00931ee34b05bad4b01eeef0558e in term 0.
14:26:15.260 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.260 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.260 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.261 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.261379 20773 leader_election.cc:304] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 
14:26:15.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.262359 21793 raft_consensus.cc:2804] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.262717 21793 raft_consensus.cc:493] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.262993 21793 raft_consensus.cc:3060] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.264 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:26:15.264 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
14:26:15.264 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
14:26:15.265 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
14:26:15.266 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
14:26:15.266 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
14:26:15.267 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
14:26:15.267 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:15.268 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
14:26:15.268 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:26:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.270977 21793 raft_consensus.cc:515] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.273986 21793 leader_election.cc:290] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Requested vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:26:15.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.274446 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:26:15.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.274940 20502 raft_consensus.cc:3060] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.281 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.282 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.282 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.282 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.282 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.282 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.283 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.280033 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.280606 20837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.281021 20838 raft_consensus.cc:2393] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9a45508766f42ca9a8dd0e64b8cd022 in current term 1: Already voted for candidate 931d00931ee34b05bad4b01eeef0558e in this term.
14:26:15.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.281255 20837 raft_consensus.cc:2468] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9a45508766f42ca9a8dd0e64b8cd022 in term 0.
14:26:15.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.285099 20435 leader_election.cc:304] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 
14:26:15.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.286163 21801 raft_consensus.cc:2804] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.286 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:15.286 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:15.287 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:15.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.286490 21801 raft_consensus.cc:493] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.286782 21801 raft_consensus.cc:3060] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.288 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:15.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.291929 20501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.293475 20837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.294040 20837 raft_consensus.cc:2468] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af07db694a34546869fea4ba492b323 in term 0.
14:26:15.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.294670 21786 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:15.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.295126 21786 ts_tablet_manager.cc:1403] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.187s	user 0.046s	sys 0.099s
14:26:15.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.292961 21787 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.297951 21786 raft_consensus.cc:359] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.298484 21786 raft_consensus.cc:385] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.294422 20580 leader_election.cc:343] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.298741 21786 raft_consensus.cc:740] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.301 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:15.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.300505 21801 raft_consensus.cc:515] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.301 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:15.301 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:15.301 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:15.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:15.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:15.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:15.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:15.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:15.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:15.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:15.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:15.302 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:15.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.301595 20502 raft_consensus.cc:2468] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 931d00931ee34b05bad4b01eeef0558e in term 1.
14:26:15.302 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.301 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.302 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.303 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.303 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.300712 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.295872 21787 ts_tablet_manager.cc:1403] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.257s	user 0.025s	sys 0.083s
14:26:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.304245 20773 leader_election.cc:304] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 
14:26:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.299397 21786 consensus_queue.cc:260] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.305491 21793 raft_consensus.cc:2804] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.305981 21793 raft_consensus.cc:697] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [term 1 LEADER]: Becoming Leader. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Running, Role: LEADER
14:26:15.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.306703 21801 leader_election.cc:290] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Requested vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.306911 21793 consensus_queue.cc:237] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.308594 20556 tablet.cc:2404] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.311862 21788 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.312711 21788 ts_tablet_manager.cc:1403] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.178s	user 0.030s	sys 0.035s
14:26:15.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.313659 21786 ts_tablet_manager.cc:1434] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.006s
14:26:15.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.314532 21786 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:15.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.316776 21788 raft_consensus.cc:359] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.317090 20837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e"
14:26:15.320 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.320 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.320 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.320 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.320 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.320 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.320 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.320 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.320 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.321 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.321 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.321 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.321 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.317569 20837 raft_consensus.cc:3060] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.336041 20644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323"
14:26:15.340 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.340 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.340 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.341 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.341 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.339260 21788 raft_consensus.cc:385] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.340582 21788 raft_consensus.cc:740] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.343277 21788 consensus_queue.cc:260] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.343999 20578 leader_election.cc:304] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6af07db694a34546869fea4ba492b323, 931d00931ee34b05bad4b01eeef0558e; no voters: e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.346 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:15.346 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:15.346 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:15.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.346328 21792 raft_consensus.cc:2804] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.347 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.347 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.347 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.347 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.347 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.347 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:15.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.346725 21792 raft_consensus.cc:493] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.349340 20643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.346578 20578 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.148.3:33363, user_credentials={real_user=slave}} blocked reactor thread for 51218.4us
14:26:15.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.351336 21792 raft_consensus.cc:3060] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.348209 20644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.352193 20642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323"
14:26:15.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.353875 20435 leader_election.cc:343] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.360 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.360234 21788 ts_tablet_manager.cc:1434] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
14:26:15.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.362100 21787 raft_consensus.cc:359] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.363471 20435 leader_election.cc:343] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.364041 20435 leader_election.cc:304] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9a45508766f42ca9a8dd0e64b8cd022; no voters: 6af07db694a34546869fea4ba492b323, 931d00931ee34b05bad4b01eeef0558e
14:26:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.365280 21801 raft_consensus.cc:2749] T e3a4162415154ed8ba26ea64fa8f8161 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:15.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.365091 21788 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:15.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.369949 21792 raft_consensus.cc:515] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.371750 20435 leader_election.cc:343] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.372526 21792 leader_election.cc:290] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Requested vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.362932 21787 raft_consensus.cc:385] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.373528 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:26:15.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.376521 20580 leader_election.cc:343] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.375321 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e"
14:26:15.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.379089 20838 raft_consensus.cc:3060] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.379132 20771 leader_election.cc:343] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.379873 20771 leader_election.cc:343] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.380887 21786 tablet_bootstrap.cc:654] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:15.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.385313 20773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.148.1:36125, user_credentials={real_user=slave}} blocked reactor thread for 81130.1us
14:26:15.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.373909 21787 raft_consensus.cc:740] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.389149 21788 tablet_bootstrap.cc:654] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:15.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.395506 20302 catalog_manager.cc:5697] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e reported cstate change: term changed from 0 to 1, leader changed from <none> to 931d00931ee34b05bad4b01eeef0558e (127.19.148.3). New cstate: current_term: 1 leader_uuid: "931d00931ee34b05bad4b01eeef0558e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: HEALTHY } } }
14:26:15.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.389202 21787 consensus_queue.cc:260] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.400 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.400 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.400 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.401677 21788 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.402 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.402235 21788 ts_tablet_manager.cc:1403] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.011s
14:26:15.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.401050 21787 ts_tablet_manager.cc:1434] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.000s
14:26:15.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.405090 21788 raft_consensus.cc:359] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.405577 21787 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:15.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.405915 21788 raft_consensus.cc:385] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.406282 21788 raft_consensus.cc:740] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.407003 21788 consensus_queue.cc:260] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.411708 21788 ts_tablet_manager.cc:1434] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
14:26:15.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.412631 21788 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:15.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.418783 21788 tablet_bootstrap.cc:654] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:15.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.420 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.420 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.421 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.440815 21787 tablet_bootstrap.cc:654] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:15.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.444672 21786 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.445143 21786 ts_tablet_manager.cc:1403] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.011s
14:26:15.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.447147 21788 tablet_bootstrap.cc:492] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.447625 21788 ts_tablet_manager.cc:1403] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.020s
14:26:15.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.450518 21788 raft_consensus.cc:359] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.451264 21788 raft_consensus.cc:385] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.451675 21788 raft_consensus.cc:740] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.452359 21788 consensus_queue.cc:260] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.456283 21788 ts_tablet_manager.cc:1434] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
14:26:15.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.457302 21788 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022: Bootstrap starting.
14:26:15.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.463847 21788 tablet_bootstrap.cc:654] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022: Neither blocks nor log segments found. Creating new log.
14:26:15.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.439185 20837 raft_consensus.cc:2468] T ad4d7093598a433b8ed42c0520e061c7 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9a45508766f42ca9a8dd0e64b8cd022 in term 1.
14:26:15.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.467507 20838 raft_consensus.cc:2468] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af07db694a34546869fea4ba492b323 in term 1.
14:26:15.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.468983 20578 leader_election.cc:304] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6af07db694a34546869fea4ba492b323, 931d00931ee34b05bad4b01eeef0558e; no voters: e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.470288 20435 leader_election.cc:304] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 6af07db694a34546869fea4ba492b323
14:26:15.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.471024 21801 raft_consensus.cc:2804] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.471485 21801 raft_consensus.cc:697] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 LEADER]: Becoming Leader. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Running, Role: LEADER
14:26:15.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.471776 21819 raft_consensus.cc:493] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.472348 21801 consensus_queue.cc:237] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.472419 21819 raft_consensus.cc:515] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.474304 21792 raft_consensus.cc:2804] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.482404 21792 raft_consensus.cc:697] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [term 1 LEADER]: Becoming Leader. State: Replica: 6af07db694a34546869fea4ba492b323, State: Running, Role: LEADER
14:26:15.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.483446 21792 consensus_queue.cc:237] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.491185 21787 tablet_bootstrap.cc:492] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:15.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.491708 21787 ts_tablet_manager.cc:1403] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.006s
14:26:15.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.491881 21788 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022: No bootstrap required, opened a new log
14:26:15.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.492274 21788 ts_tablet_manager.cc:1403] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
14:26:15.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.494886 21788 raft_consensus.cc:359] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.495783 21788 raft_consensus.cc:385] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.496091 21788 raft_consensus.cc:740] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Initialized, Role: FOLLOWER
14:26:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.495239 21787 raft_consensus.cc:359] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.496717 21787 raft_consensus.cc:385] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.496762 21788 consensus_queue.cc:260] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.497092 21787 raft_consensus.cc:740] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.499173 21788 ts_tablet_manager.cc:1434] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
14:26:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.501282 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.501120 21819 leader_election.cc:290] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:26:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.501446 21787 consensus_queue.cc:260] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.501930 20502 raft_consensus.cc:2468] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 931d00931ee34b05bad4b01eeef0558e in term 0.
14:26:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.503592 21787 ts_tablet_manager.cc:1434] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
14:26:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.503604 20773 leader_election.cc:304] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 
14:26:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.504448 21787 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.504540 21793 raft_consensus.cc:2804] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.504593 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.504881 21793 raft_consensus.cc:493] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.505168 21793 raft_consensus.cc:3060] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.506572 21754 heartbeater.cc:499] Master 127.20.103.125:34309 was elected leader, sending a full tablet report...
14:26:15.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.506687 20771 leader_election.cc:343] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.510056 21801 raft_consensus.cc:493] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.510444 21801 raft_consensus.cc:515] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.512110 21801 leader_election.cc:290] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.513931 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.515206 21793 raft_consensus.cc:515] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.515554 20435 leader_election.cc:343] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.517112 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.517879 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:26:15.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.518366 20502 raft_consensus.cc:3060] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.524791 20502 raft_consensus.cc:2468] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 931d00931ee34b05bad4b01eeef0558e in term 1.
14:26:15.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.524214 21786 raft_consensus.cc:359] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.525771 20773 leader_election.cc:304] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 
14:26:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.526973 21793 leader_election.cc:290] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Requested vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473)
14:26:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.527550 21793 raft_consensus.cc:2804] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.527720 21787 tablet_bootstrap.cc:654] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.528048 21793 raft_consensus.cc:697] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [term 1 LEADER]: Becoming Leader. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Running, Role: LEADER
14:26:15.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.528890 21793 consensus_queue.cc:237] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.530119 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323"
14:26:15.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.525370 21786 raft_consensus.cc:385] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.532104 21786 raft_consensus.cc:740] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.532675 21786 consensus_queue.cc:260] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.534109 20771 leader_election.cc:343] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.536896 20838 raft_consensus.cc:2468] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9a45508766f42ca9a8dd0e64b8cd022 in term 0.
14:26:15.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.539165 20435 leader_election.cc:304] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 6af07db694a34546869fea4ba492b323
14:26:15.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.539858 21801 raft_consensus.cc:493] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.540277 21801 raft_consensus.cc:515] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.541930 21801 leader_election.cc:290] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.543825 21786 ts_tablet_manager.cc:1434] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.006s
14:26:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.543844 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.544026 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4652257de6734e049df6608b64d5e2b1" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.544762 20838 raft_consensus.cc:2393] T 4652257de6734e049df6608b64d5e2b1 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9a45508766f42ca9a8dd0e64b8cd022 in current term 1: Already voted for candidate 6af07db694a34546869fea4ba492b323 in this term.
14:26:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.545475 21801 raft_consensus.cc:2804] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.545768 21801 raft_consensus.cc:493] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.545845 21786 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e: Bootstrap starting.
14:26:15.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.546087 21801 raft_consensus.cc:3060] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.546840 20435 leader_election.cc:304] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9a45508766f42ca9a8dd0e64b8cd022; no voters: 6af07db694a34546869fea4ba492b323, 931d00931ee34b05bad4b01eeef0558e
14:26:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.547798 21795 raft_consensus.cc:3060] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.551208 20301 catalog_manager.cc:5697] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6af07db694a34546869fea4ba492b323 (127.19.148.2). New cstate: current_term: 1 leader_uuid: "6af07db694a34546869fea4ba492b323" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: UNKNOWN } } }
14:26:15.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.557204 21795 raft_consensus.cc:2749] T 4652257de6734e049df6608b64d5e2b1 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:15.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.565214 21792 raft_consensus.cc:493] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.565588 21792 raft_consensus.cc:515] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.567384 21792 leader_election.cc:290] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363), e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:26:15.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.568482 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.568638 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.568958 20502 raft_consensus.cc:2468] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af07db694a34546869fea4ba492b323 in term 0.
14:26:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.572104 20578 leader_election.cc:343] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.573673 20580 leader_election.cc:304] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6af07db694a34546869fea4ba492b323, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 931d00931ee34b05bad4b01eeef0558e
14:26:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.570648 21801 raft_consensus.cc:515] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.574682 21792 raft_consensus.cc:2804] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.575002 21792 raft_consensus.cc:493] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:15.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.575330 21792 raft_consensus.cc:3060] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.576602 20645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323"
14:26:15.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.578127 20435 leader_election.cc:343] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.580295 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e"
14:26:15.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.580778 20838 raft_consensus.cc:3060] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.587960 20303 catalog_manager.cc:5697] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1). New cstate: current_term: 1 leader_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: UNKNOWN } } }
14:26:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.588618 20838 raft_consensus.cc:2468] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9a45508766f42ca9a8dd0e64b8cd022 in term 1.
14:26:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.589287 21792 raft_consensus.cc:515] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.589543 20435 leader_election.cc:304] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 6af07db694a34546869fea4ba492b323
14:26:15.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.590219 21795 raft_consensus.cc:2804] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.591835 20837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e"
14:26:15.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.594110 20578 leader_election.cc:343] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363): Illegal state: must be running to vote when last-logged opid is not known
14:26:15.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.594623 21795 raft_consensus.cc:697] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 LEADER]: Becoming Leader. State: Replica: e9a45508766f42ca9a8dd0e64b8cd022, State: Running, Role: LEADER
14:26:15.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.595523 21795 consensus_queue.cc:237] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.597791 21801 leader_election.cc:290] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [CANDIDATE]: Term 1 election: Requested vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.602562 21792 leader_election.cc:290] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Requested vote from peers 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363), e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:26:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.603478 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022"
14:26:15.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.604004 20502 raft_consensus.cc:3060] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.605161 21787 tablet_bootstrap.cc:492] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:15.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.606961 21787 ts_tablet_manager.cc:1403] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.033s
14:26:15.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.611284 21786 tablet_bootstrap.cc:654] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e: Neither blocks nor log segments found. Creating new log.
14:26:15.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.617528 20502 raft_consensus.cc:2468] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af07db694a34546869fea4ba492b323 in term 1.
14:26:15.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.618886 20580 leader_election.cc:304] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6af07db694a34546869fea4ba492b323, e9a45508766f42ca9a8dd0e64b8cd022; no voters: 931d00931ee34b05bad4b01eeef0558e
14:26:15.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.619825 21792 raft_consensus.cc:2804] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Leader election won for term 1
14:26:15.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.620266 21792 raft_consensus.cc:697] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [term 1 LEADER]: Becoming Leader. State: Replica: 6af07db694a34546869fea4ba492b323, State: Running, Role: LEADER
14:26:15.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.621001 21792 consensus_queue.cc:237] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.615753 21787 raft_consensus.cc:359] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.624678 21787 raft_consensus.cc:385] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.625627 21787 raft_consensus.cc:740] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.626359 21787 consensus_queue.cc:260] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.636937 20303 catalog_manager.cc:5697] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1). New cstate: current_term: 1 leader_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: UNKNOWN } } }
14:26:15.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.638896 21787 ts_tablet_manager.cc:1434] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
14:26:15.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.643683 21787 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:15.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.645903 21786 tablet_bootstrap.cc:492] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e: No bootstrap required, opened a new log
14:26:15.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.646353 21786 ts_tablet_manager.cc:1403] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.000s
14:26:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.649147 21786 raft_consensus.cc:359] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.655118 21786 raft_consensus.cc:385] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.655418 21786 raft_consensus.cc:740] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931d00931ee34b05bad4b01eeef0558e, State: Initialized, Role: FOLLOWER
14:26:15.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.655956 21786 consensus_queue.cc:260] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.660 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:15.660 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:15.660 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:15.660 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.660 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:15.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:15.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:15.661 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.662099 21786 ts_tablet_manager.cc:1434] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
14:26:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.664592 21787 tablet_bootstrap.cc:654] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:15.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.666352 20302 catalog_manager.cc:5697] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e reported cstate change: term changed from 0 to 1, leader changed from <none> to 931d00931ee34b05bad4b01eeef0558e (127.19.148.3). New cstate: current_term: 1 leader_uuid: "931d00931ee34b05bad4b01eeef0558e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: HEALTHY } } }
14:26:15.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.666857 20301 catalog_manager.cc:5697] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6af07db694a34546869fea4ba492b323 (127.19.148.2). New cstate: current_term: 1 leader_uuid: "6af07db694a34546869fea4ba492b323" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } health_report { overall_health: UNKNOWN } } }
14:26:15.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.668609 21792 raft_consensus.cc:493] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.669001 21792 raft_consensus.cc:515] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.670650 21792 leader_election.cc:290] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.671387 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.672075 20502 raft_consensus.cc:2393] T ed72fc8fc2a449d0b2c8519ac4872540 P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6af07db694a34546869fea4ba492b323 in current term 1: Already voted for candidate 931d00931ee34b05bad4b01eeef0558e in this term.
14:26:15.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.672190 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed72fc8fc2a449d0b2c8519ac4872540" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.686538 20580 leader_election.cc:304] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6af07db694a34546869fea4ba492b323; no voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.687218 21792 raft_consensus.cc:3060] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.694442 21792 raft_consensus.cc:2749] T ed72fc8fc2a449d0b2c8519ac4872540 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:15.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.696655 21787 tablet_bootstrap.cc:492] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.697019 21787 ts_tablet_manager.cc:1403] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.005s
14:26:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.699476 21787 raft_consensus.cc:359] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.700150 21787 raft_consensus.cc:385] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.700369 21787 raft_consensus.cc:740] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.702606 21787 consensus_queue.cc:260] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.708446 21787 ts_tablet_manager.cc:1434] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
14:26:15.712 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:15.712 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:15.712 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:15.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:15.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:15.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.716 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.716 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:15.716 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:15.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.720500 21787 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323: Bootstrap starting.
14:26:15.728 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:15.728 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:15.728 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:15.728 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.728 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.728 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.729 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.729 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.729 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.730 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.730 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:15.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.740607 21787 tablet_bootstrap.cc:654] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323: Neither blocks nor log segments found. Creating new log.
14:26:15.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.759256 21787 tablet_bootstrap.cc:492] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323: No bootstrap required, opened a new log
14:26:15.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.760098 21787 ts_tablet_manager.cc:1403] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.004s
14:26:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.762537 21787 raft_consensus.cc:359] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.763599 21787 raft_consensus.cc:385] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:15.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.763844 21787 raft_consensus.cc:740] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af07db694a34546869fea4ba492b323, State: Initialized, Role: FOLLOWER
14:26:15.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.764705 21787 consensus_queue.cc:260] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.772053 21787 ts_tablet_manager.cc:1434] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
14:26:15.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.775224 21793 consensus_queue.cc:1048] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:15.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.789678 21792 raft_consensus.cc:493] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.790099 21792 raft_consensus.cc:515] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.791676 21792 leader_election.cc:290] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.792294 20501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.794047 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a4162415154ed8ba26ea64fa8f8161" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:15.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.795800 20578 leader_election.cc:304] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6af07db694a34546869fea4ba492b323; no voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.798280 21792 raft_consensus.cc:2749] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:15.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:15.802 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:15.802 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.19.148.60:37365, [5ms] Sub RPC GetTableLocations: received response from server master-127.19.148.60:37365: OK, deferred=null) after lookup
14:26:15.802 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:15.816 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:15.822 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:15.822 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:15.822 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:15.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.823 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.823 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.823 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:15.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.827199 20645 raft_consensus.cc:3060] T e3a4162415154ed8ba26ea64fa8f8161 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.830384 21819 raft_consensus.cc:493] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.830873 21819 raft_consensus.cc:515] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } }
14:26:15.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.832729 21819 leader_election.cc:290] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473), e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125)
14:26:15.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.834345 20642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af07db694a34546869fea4ba492b323" is_pre_election: true
14:26:15.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.839291 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fedcdf5784f7f8b123aa3e85deaaa" candidate_uuid: "931d00931ee34b05bad4b01eeef0558e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.842231 20502 raft_consensus.cc:2393] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 931d00931ee34b05bad4b01eeef0558e in current term 1: Already voted for candidate 6af07db694a34546869fea4ba492b323 in this term.
14:26:15.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.843297 20773 leader_election.cc:304] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 931d00931ee34b05bad4b01eeef0558e; no voters: 6af07db694a34546869fea4ba492b323, e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.844396 21819 raft_consensus.cc:3060] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 0 FOLLOWER]: Advancing to term 1
14:26:15.845 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:15.852 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xffc2fbb9, L:/127.0.0.1:37832 - R:/127.19.148.2:42473] using TOKEN/null
14:26:15.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:15.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.874294 20501 raft_consensus.cc:1275] T 394fedcdf5784f7f8b123aa3e85deaaa P e9a45508766f42ca9a8dd0e64b8cd022 [term 1 FOLLOWER]: Refusing update from remote peer 6af07db694a34546869fea4ba492b323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.876741 21792 consensus_queue.cc:1048] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:15.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.881484 21819 raft_consensus.cc:2749] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:15.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.883204 20838 raft_consensus.cc:1275] T 394fedcdf5784f7f8b123aa3e85deaaa P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Refusing update from remote peer 6af07db694a34546869fea4ba492b323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.887825 21792 consensus_queue.cc:1048] T 394fedcdf5784f7f8b123aa3e85deaaa P 6af07db694a34546869fea4ba492b323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:15.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.890126 21855 consensus_queue.cc:1048] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:15.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.893121 21795 consensus_queue.cc:1048] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:15.908 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:15.908 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:15.908 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:15.910 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.910 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.914 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:15.915 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:15.915 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29764), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [43ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [45ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [66ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [68ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [68ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [87ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [87ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [87ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [161ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [162ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [243ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [383ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [641ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [642ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [642ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [642ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [701ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [701ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [702ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [702ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1602ms] refreshing cache from master, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1604ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1604ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1604ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3121ms] refreshing cache from master, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [3123ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5900ms] refreshing cache from master, [5901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5901ms] too many traces: truncated at 100 traces, deferred=Deferred@140044764(state=PENDING, result=null, callback=(continuation of Deferred@1306540961 after retry RPC after error@8387991) -> (continuation of Deferred@874543327 after retry RPC after error@2079945102) -> (continuation of Deferred@923299939 after retry RPC after error@1222946896) -> (continuation of Deferred@2142621459 after retry RPC after error@1332786282) -> (continuation of Deferred@990858895 after retry RPC after error@1451499406) -> (continuation of Deferred@127442714 after retry RPC after error@1291954279) -> (continuation of Deferred@205253758 after retry RPC after error@2058746392) -> (continuation of Deferred@957794843 after retry RPC after error@2031361998) -> (continuation of Deferred@715084942 after retry RPC after error@2142183167) -> (continuation of Deferred@1885754627 after retry RPC after error@693493422) -> (continuation of Deferred@2034160686 after retry RPC after error@2128704784) -> (continuation of Deferred@1013840258 after retry RPC after error@1003155471) -> (continuation of Deferred@878365948 after retry RPC after error@1097234066) -> (continuation of Deferred@311703253 after retry RPC after error@2125657600) -> (continuation of Deferred@476964870 after retry RPC after error@1858981887) -> (continuation of Deferred@1566338669 after retry RPC after error@884445488) -> (continuation of Deferred@1198092920 after retry RPC after error@1197211485) -> (continuation of Deferred@2043334365 after retry RPC after error@1912401605) -> (continuation of Deferred@2097850416 after retry RPC after error@1706234331) -> (continuation of Deferred@1243645846 after retry RPC after error@1547485905) -> (continuation of Deferred@1952430670 after retry RPC after error@161435863) -> (continuation of Deferred@1204648517 after retry RPC after error@2111640103) -> (continuation of Deferred@1952012824 after retry RPC after error@129213868) -> (continuation of Deferred@729872461 after retry RPC after error@1046055728) -> (continuation of Deferred@7249785 after retry RPC after error@451597341), errback=(continuation of Deferred@1306540961 after retry RPC after error@8387991) -> (continuation of Deferred@874543327 after retry RPC after error@2079945102) -> (continuation of Deferred@923299939 after retry RPC after error@1222946896) -> (continuation of Deferred@2142621459 after retry RPC after error@1332786282) -> (continuation of Deferred@990858895 after retry RPC after error@1451499406) -> (continuation of Deferred@127442714 after retry RPC after error@1291954279) -> (continuation of Deferred@205253758 after retry RPC after error@2058746392) -> (continuation of Deferred@957794843 after retry RPC after error@2031361998) -> (continuation of Deferred@715084942 after retry RPC after error@2142183167) -> (continuation of Deferred@1885754627 after retry RPC after error@693493422) -> (continuation of Deferred@2034160686 after retry RPC after error@2128704784) -> (continuation of Deferred@1013840258 after retry RPC after error@1003155471) -> (continuation of Deferred@878365948 after retry RPC after error@1097234066) -> (continuation of Deferred@311703253 after retry RPC after error@2125657600) -> (continuation of Deferred@476964870 after retry RPC after error@1858981887) -> (continuation of Deferred@1566338669 after retry RPC after error@884445488) -> (continuation of Deferred@1198092920 after retry RPC after error@1197211485) -> (continuation of Deferred@2043334365 after retry RPC after error@1912401605) -> (continuation of Deferred@2097850416 after retry RPC after error@1706234331) -> (continuation of Deferred@1243645846 after retry RPC after error@1547485905) -> (continuation of Deferred@1952430670 after retry RPC after error@161435863) -> (continuation of Deferred@1204648517 after retry RPC after error@2111640103) -> (continuation of Deferred@1952012824 after retry RPC after error@129213868) -> (continuation of Deferred@729872461 after retry RPC after error@1046055728) -> (continuation of Deferred@7249785 after retry RPC after error@451597341)))
14:26:15.915 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:15.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:15.915 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:15.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:15.916 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.916 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:15.916 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:15.917 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29883), Traces: [0ms] refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [100ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [108ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [110ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [150ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [151ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [152ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [153ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [169ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [170ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [170ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [181ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [181ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [201ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [202ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [202ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [243ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [302ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [641ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [641ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [641ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [642ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1002ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1166ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1168ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1169ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1169ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1602ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5561ms] refreshing cache from master, [5561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5562ms] too many traces: truncated at 100 traces, deferred=Deferred@994555329(state=PENDING, result=null, callback=(continuation of Deferred@2035964948 after retry RPC after error@379991894) -> (continuation of Deferred@151953892 after retry RPC after error@258077881) -> (continuation of Deferred@619750333 after retry RPC after error@55258354) -> (continuation of Deferred@2134289662 after retry RPC after error@2138200989) -> (continuation of Deferred@1589568133 after retry RPC after error@80242972) -> (continuation of Deferred@1314092071 after retry RPC after error@596664515) -> (continuation of Deferred@169018622 after retry RPC after error@1297353769) -> (continuation of Deferred@410233832 after retry RPC after error@944064093) -> (continuation of Deferred@719556959 after retry RPC after error@1203496302) -> (continuation of Deferred@1108486810 after retry RPC after error@1358424875) -> (continuation of Deferred@1722343683 after retry RPC after error@2124474413) -> (continuation of Deferred@766856089 after retry RPC after error@1123304375) -> (continuation of Deferred@1668616723 after retry RPC after error@443383760) -> (continuation of Deferred@495126151 after retry RPC after error@2106197883) -> (continuation of Deferred@916744019 after retry RPC after error@1204166056) -> (continuation of Deferred@1123327209 after retry RPC after error@1869146643) -> (continuation of Deferred@2053346898 after retry RPC after error@222293995) -> (continuation of Deferred@1800022385 after retry RPC after error@1138388601) -> (continuation of Deferred@627941718 after retry RPC after error@1474249383) -> (continuation of Deferred@1843718284 after retry RPC after error@2103306991) -> (continuation of Deferred@905089795 after retry RPC after error@412431712) -> (continuation of Deferred@1384062582 after retry RPC after error@1088916548), errback=(continuation of Deferred@2035964948 after retry RPC after error@379991894) -> (continuation of Deferred@151953892 after retry RPC after error@258077881) -> (continuation of Deferred@619750333 after retry RPC after error@55258354) -> (continuation of Deferred@2134289662 after retry RPC after error@2138200989) -> (continuation of Deferred@1589568133 after retry RPC after error@80242972) -> (continuation of Deferred@1314092071 after retry RPC after error@596664515) -> (continuation of Deferred@169018622 after retry RPC after error@1297353769) -> (continuation of Deferred@410233832 after retry RPC after error@944064093) -> (continuation of Deferred@719556959 after retry RPC after error@1203496302) -> (continuation of Deferred@1108486810 after retry RPC after error@1358424875) -> (continuation of Deferred@1722343683 after retry RPC after error@2124474413) -> (continuation of Deferred@766856089 after retry RPC after error@1123304375) -> (continuation of Deferred@1668616723 after retry RPC after error@443383760) -> (continuation of Deferred@495126151 after retry RPC after error@2106197883) -> (continuation of Deferred@916744019 after retry RPC after error@1204166056) -> (continuation of Deferred@1123327209 after retry RPC after error@1869146643) -> (continuation of Deferred@2053346898 after retry RPC after error@222293995) -> (continuation of Deferred@1800022385 after retry RPC after error@1138388601) -> (continuation of Deferred@627941718 after retry RPC after error@1474249383) -> (continuation of Deferred@1843718284 after retry RPC after error@2103306991) -> (continuation of Deferred@905089795 after retry RPC after error@412431712) -> (continuation of Deferred@1384062582 after retry RPC after error@1088916548)))
14:26:15.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:15.922024 20773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.148.1:36125, user_credentials={real_user=slave}} blocked reactor thread for 57594.7us
14:26:15.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.931772 20642 raft_consensus.cc:3060] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.941603 21830 raft_consensus.cc:493] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.942179 21830 raft_consensus.cc:515] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.944403 21830 leader_election.cc:290] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:15.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.951306 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:15.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.952186 20838 raft_consensus.cc:2393] T 4d5dd44151694c89a880404d0f161d64 P 931d00931ee34b05bad4b01eeef0558e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6af07db694a34546869fea4ba492b323 in current term 1: Already voted for candidate e9a45508766f42ca9a8dd0e64b8cd022 in this term.
14:26:15.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:15.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:15.968 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:15.969 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:15.969 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.969 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:15.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:15.969 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:15.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.971402 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5dd44151694c89a880404d0f161d64" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:15.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.972745 20580 leader_election.cc:304] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6af07db694a34546869fea4ba492b323; no voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022
14:26:15.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.973910 21830 raft_consensus.cc:3060] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 0 FOLLOWER]: Advancing to term 1
14:26:15.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:15.978562 21795 consensus_queue.cc:1048] T ad4d7093598a433b8ed42c0520e061c7 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:15.999 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:15.999 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:16.000 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:16.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.000 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.000 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:16.000 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:16.000 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:16.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.001 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.001 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.001 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.001 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:16.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.002 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:16.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.003454 21830 raft_consensus.cc:2749] T 4d5dd44151694c89a880404d0f161d64 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:16.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.009706 21801 consensus_queue.cc:1048] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:16.013 [DEBUG - main] (Connection.java:748) [peer 931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)] connecting to peer
14:26:16.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.018179 21795 consensus_queue.cc:1048] T 4d5dd44151694c89a880404d0f161d64 P e9a45508766f42ca9a8dd0e64b8cd022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:16.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.020759 21861 consensus_queue.cc:1048] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:16.027 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)] Successfully connected to peer
14:26:16.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.036348 21850 mvcc.cc:204] Tried to move back new op lower bound from 7287252483565281280 to 7287252482551136256. Current Snapshot: MvccSnapshot[applied={T|T < 7287252483565281280}]
14:26:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.053874 21859 consensus_queue.cc:1048] T 4652257de6734e049df6608b64d5e2b1 P 6af07db694a34546869fea4ba492b323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:16.086 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.090 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xc3778ab7, L:/127.0.0.1:35492 - R:/127.19.148.3:33363] using TOKEN/null
14:26:16.152 [DEBUG - main] (Connection.java:748) [peer e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)] connecting to peer
14:26:16.159 [DEBUG - kudu-nio-5] (Connection.java:757) [peer e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)] Successfully connected to peer
14:26:16.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.183 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.187 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xddfafce8, L:/127.0.0.1:34122 - R:/127.19.148.1:36125] using TOKEN/null
14:26:16.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:16.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:16.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:16.208 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.209 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.209 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:16.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.051667 21819 consensus_queue.cc:1048] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
14:26:16.230 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:16.231 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:16.231 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:16.231 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.231 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.231 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:16.232 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.232 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.232 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:16.232 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.232 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:16.232 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.233633 21852 consensus_queue.cc:1048] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:16.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.291996 21830 raft_consensus.cc:493] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9a45508766f42ca9a8dd0e64b8cd022)
14:26:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.292517 21830 raft_consensus.cc:515] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" member_type: VOTER last_known_addr { host: "127.19.148.1" port: 36125 } } peers { permanent_uuid: "6af07db694a34546869fea4ba492b323" member_type: VOTER last_known_addr { host: "127.19.148.2" port: 42473 } } peers { permanent_uuid: "931d00931ee34b05bad4b01eeef0558e" member_type: VOTER last_known_addr { host: "127.19.148.3" port: 33363 } }
14:26:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.299232 20502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9a45508766f42ca9a8dd0e64b8cd022" is_pre_election: true
14:26:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.300138 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4d7093598a433b8ed42c0520e061c7" candidate_uuid: "6af07db694a34546869fea4ba492b323" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "931d00931ee34b05bad4b01eeef0558e" is_pre_election: true
14:26:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.302606 21830 leader_election.cc:290] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125), 931d00931ee34b05bad4b01eeef0558e (127.19.148.3:33363)
14:26:16.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.303824 20580 leader_election.cc:304] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6af07db694a34546869fea4ba492b323; no voters: 931d00931ee34b05bad4b01eeef0558e, e9a45508766f42ca9a8dd0e64b8cd022
14:26:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.308648 21830 raft_consensus.cc:2749] T ad4d7093598a433b8ed42c0520e061c7 P 6af07db694a34546869fea4ba492b323 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:26:16.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.362 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.381 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:16.381 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:16.381 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:16.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:16.382 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.382 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.382 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:16.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.383 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:16.383 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:16.422 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:16.427 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:16.430 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:16.438 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:16.444 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:16.446 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:16.447 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:16.450 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:16.452 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:16.458 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:16.461 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.461 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.461 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:16.465 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8e83d57a, L:/127.0.0.1:40218 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:16.465 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x77f24ad6, L:/127.0.0.1:37116 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:16.474 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:16.474 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=46), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [38ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.124:41795: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:16.478 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:16.479 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:16.479 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.148.62:34807(127.19.148.62:34807)] Successfully connected to peer
14:26:16.480 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.481 [DEBUG - main] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:16.481 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.148.60:37365(127.19.148.60:37365)] Successfully connected to peer
14:26:16.487 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2a93e275, L:/127.0.0.1:59508 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:16.488 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.148.61:37523(127.19.148.61:37523)] Successfully connected to peer
14:26:16.493 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.62
14:26:16.500 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.60
14:26:16.501 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.504 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x90668ab8, L:/127.0.0.1:44226 - R:/127.19.148.62:34807] using SASL/PLAIN
14:26:16.506 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.61
14:26:16.509 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.513 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0b0ff29e, L:/127.0.0.1:34708 - R:/127.19.148.60:37365] using SASL/PLAIN
14:26:16.517 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:16.517 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:16.517 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=38), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [29ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: OK, deferred=null) after lookup
14:26:16.520 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:16.522 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb43320bf, L:/127.0.0.1:40696 - R:/127.19.148.61:37523] using SASL/PLAIN
14:26:16.525 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:16.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:16.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:16.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:16.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:16.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:16.528 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.531178 21013 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40218:
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:26:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:26:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:26:16.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:16.538897 21013 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:26:16.549 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:16.549 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:16.549 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:16.550 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:16.550 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:16.550 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:16.550 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:16.550 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:16.550 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:16.550 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:16.550 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:16.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:16.551 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:16.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.684 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:16.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.768867 21348 tablet_service.cc:1511] Processing CreateTablet for tablet 7b84f2b00f7d4bd483a216521cbc693a (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.771078 21347 tablet_service.cc:1511] Processing CreateTablet for tablet 050aee52c0944bd8b2f5766c38016439 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.772763 21347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050aee52c0944bd8b2f5766c38016439. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.775362 21346 tablet_service.cc:1511] Processing CreateTablet for tablet eb57a75ce4fc4f34a064173a55fc60fa (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:16.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.776909 21349 tablet_service.cc:1511] Processing CreateTablet for tablet ea76dbfe58b54be491e3904c3b089ecb (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:16.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.778187 21345 tablet_service.cc:1511] Processing CreateTablet for tablet 64c4faa671754965bbf21cbab502f65f (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:16.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.779451 21350 tablet_service.cc:1511] Processing CreateTablet for tablet a48d550c478645c4a86bb681c15c1b56 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:16.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.783409 21348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b84f2b00f7d4bd483a216521cbc693a. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.785411 21349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea76dbfe58b54be491e3904c3b089ecb. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.786602 21346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb57a75ce4fc4f34a064173a55fc60fa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.788156 21345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4faa671754965bbf21cbab502f65f. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.795136 21350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d550c478645c4a86bb681c15c1b56. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.803061 21543 tablet_service.cc:1511] Processing CreateTablet for tablet 050aee52c0944bd8b2f5766c38016439 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.804629 21543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050aee52c0944bd8b2f5766c38016439. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.806789 21544 tablet_service.cc:1511] Processing CreateTablet for tablet 7b84f2b00f7d4bd483a216521cbc693a (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.807768 21544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b84f2b00f7d4bd483a216521cbc693a. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.809893 21541 tablet_service.cc:1511] Processing CreateTablet for tablet 64c4faa671754965bbf21cbab502f65f (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:16.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.810811 21541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4faa671754965bbf21cbab502f65f. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.817567 21542 tablet_service.cc:1511] Processing CreateTablet for tablet eb57a75ce4fc4f34a064173a55fc60fa (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:16.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.818615 21542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb57a75ce4fc4f34a064173a55fc60fa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.821071 21545 tablet_service.cc:1511] Processing CreateTablet for tablet ea76dbfe58b54be491e3904c3b089ecb (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:16.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.822101 21545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea76dbfe58b54be491e3904c3b089ecb. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.825328 21546 tablet_service.cc:1511] Processing CreateTablet for tablet a48d550c478645c4a86bb681c15c1b56 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:16.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.829849 21546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d550c478645c4a86bb681c15c1b56. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.835269 21685 tablet_service.cc:1511] Processing CreateTablet for tablet 050aee52c0944bd8b2f5766c38016439 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
14:26:16.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.835757 21687 tablet_service.cc:1511] Processing CreateTablet for tablet ea76dbfe58b54be491e3904c3b089ecb (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
14:26:16.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.837029 21685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050aee52c0944bd8b2f5766c38016439. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.838832 21682 tablet_service.cc:1511] Processing CreateTablet for tablet 64c4faa671754965bbf21cbab502f65f (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
14:26:16.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.840341 21684 tablet_service.cc:1511] Processing CreateTablet for tablet eb57a75ce4fc4f34a064173a55fc60fa (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
14:26:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.841254 21686 tablet_service.cc:1511] Processing CreateTablet for tablet 7b84f2b00f7d4bd483a216521cbc693a (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
14:26:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.844115 21682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c4faa671754965bbf21cbab502f65f. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.850246 21684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb57a75ce4fc4f34a064173a55fc60fa. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.851954 21686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b84f2b00f7d4bd483a216521cbc693a. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.853609 21687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea76dbfe58b54be491e3904c3b089ecb. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.855 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:16.855 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:16.855 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:16.856 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.856 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.856 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:16.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.856 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:16.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:16.856 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:16.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:16.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.856865 21688 tablet_service.cc:1511] Processing CreateTablet for tablet a48d550c478645c4a86bb681c15c1b56 (DEFAULT_TABLE table=replication_test_table [id=511b5d833e2540fc82b2af60f12d2689]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
14:26:16.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.859230 21688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d550c478645c4a86bb681c15c1b56. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.929944 21911 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:16.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.973223 21911 tablet_bootstrap.cc:654] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:16.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.988032 21912 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:16.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.989673 21911 log.cc:826] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Log is configured to *not* fsync() on all Append() calls
14:26:16.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:16.991302 21913 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.007951 21913 tablet_bootstrap.cc:654] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.010689 21911 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.011286 21911 ts_tablet_manager.cc:1403] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.009s
14:26:17.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.012938 21912 tablet_bootstrap.cc:654] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.019824 21913 log.cc:826] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: Log is configured to *not* fsync() on all Append() calls
14:26:17.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.022933 21912 log.cc:826] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: Log is configured to *not* fsync() on all Append() calls
14:26:17.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.037418 21913 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.037990 21913 ts_tablet_manager.cc:1403] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.005s
14:26:17.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.059702 21912 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.063753 21912 ts_tablet_manager.cc:1403] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.011s
14:26:17.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.067917 21913 raft_consensus.cc:359] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.069047 21913 raft_consensus.cc:385] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.069379 21913 raft_consensus.cc:740] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.070909 21913 consensus_queue.cc:260] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.084302 21913 ts_tablet_manager.cc:1434] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.046s	user 0.036s	sys 0.003s
14:26:17.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.101362 21913 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.110038 21918 raft_consensus.cc:493] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.110512 21918 raft_consensus.cc:515] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.120182 21913 tablet_bootstrap.cc:654] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.120576 21918 leader_election.cc:290] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.134742 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.138525 21641 leader_election.cc:343] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.138450 21911 raft_consensus.cc:359] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.139264 21911 raft_consensus.cc:385] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.139654 21911 raft_consensus.cc:740] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.140508 21911 consensus_queue.cc:260] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.144301 21913 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.144799 21913 ts_tablet_manager.cc:1403] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
14:26:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.147603 21913 raft_consensus.cc:359] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.148422 21913 raft_consensus.cc:385] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.148774 21913 raft_consensus.cc:740] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.149578 21913 consensus_queue.cc:260] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.151 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:17.151 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:17.151 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:17.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:17.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:17.152 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:17.152 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:17.152 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:17.152 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:17.152 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.152586 21913 ts_tablet_manager.cc:1434] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
14:26:17.152 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:17.152 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:17.152 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:17.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.153816 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.157912 21640 leader_election.cc:343] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.158314 21640 leader_election.cc:304] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6; no voters: 53d7c903ee4c473aa5f0b637189c6e7d, 8e2070f9879f4b97aca892de05842e15
14:26:17.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.159121 21918 raft_consensus.cc:2749] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:17.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.153896 21912 raft_consensus.cc:359] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.160322 21913 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.161556 21911 ts_tablet_manager.cc:1434] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.148s	user 0.029s	sys 0.013s
14:26:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.168118 21912 raft_consensus.cc:385] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.168418 21912 raft_consensus.cc:740] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.169234 21912 consensus_queue.cc:260] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.176581 21913 tablet_bootstrap.cc:654] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.175925 21912 ts_tablet_manager.cc:1434] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.112s	user 0.032s	sys 0.002s
14:26:17.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.177807 21912 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:17.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.189723 21912 tablet_bootstrap.cc:654] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.194185 21911 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:17.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.196440 21913 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.199569 21912 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.200119 21912 ts_tablet_manager.cc:1403] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
14:26:17.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.201237 21911 tablet_bootstrap.cc:654] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:17.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.198575 21913 ts_tablet_manager.cc:1403] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.000s
14:26:17.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.203410 21912 raft_consensus.cc:359] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.204445 21912 raft_consensus.cc:385] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.204936 21912 raft_consensus.cc:740] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.206060 21912 consensus_queue.cc:260] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.207132 21913 raft_consensus.cc:359] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.207744 21913 raft_consensus.cc:385] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.207971 21913 raft_consensus.cc:740] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.208551 21913 consensus_queue.cc:260] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.214038 21923 raft_consensus.cc:493] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.214660 21923 raft_consensus.cc:515] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.217141 21912 ts_tablet_manager.cc:1434] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
14:26:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.220929 21924 raft_consensus.cc:493] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.221194 21760 tablet.cc:2404] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:17.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.221553 21924 raft_consensus.cc:515] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.227387 21923 leader_election.cc:290] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.231021 21913 ts_tablet_manager.cc:1434] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
14:26:17.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.242105 21618 tablet.cc:2404] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:17.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.243558 21913 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.242867 21924 leader_election.cc:290] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.251169 21913 tablet_bootstrap.cc:654] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.267050 21912 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.293283 21911 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.294759 21911 ts_tablet_manager.cc:1403] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.101s	user 0.046s	sys 0.025s
14:26:17.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.296224 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.299772 21297 leader_election.cc:343] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.301435 21912 tablet_bootstrap.cc:654] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.308526 21911 raft_consensus.cc:359] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.309235 21911 raft_consensus.cc:385] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.309540 21911 raft_consensus.cc:740] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.310226 21911 consensus_queue.cc:260] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.311197 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.313055 21499 leader_election.cc:343] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.314744 21913 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.315162 21913 ts_tablet_manager.cc:1403] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.046s
14:26:17.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.317265 21911 ts_tablet_manager.cc:1434] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
14:26:17.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.318070 21911 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:17.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.317909 21913 raft_consensus.cc:359] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.318612 21913 raft_consensus.cc:385] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.318929 21913 raft_consensus.cc:740] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.319610 21913 consensus_queue.cc:260] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.329188 21913 ts_tablet_manager.cc:1434] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
14:26:17.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.330057 21913 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.332278 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.333465 21496 leader_election.cc:343] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.333823 21496 leader_election.cc:304] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e2070f9879f4b97aca892de05842e15; no voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d
14:26:17.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.334894 21924 raft_consensus.cc:2749] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:17.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.338428 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.339097 21913 tablet_bootstrap.cc:654] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.339011 21708 raft_consensus.cc:2468] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53d7c903ee4c473aa5f0b637189c6e7d in term 0.
14:26:17.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.340523 21300 leader_election.cc:304] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 8e2070f9879f4b97aca892de05842e15
14:26:17.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.341321 21923 raft_consensus.cc:2804] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:17.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.341661 21923 raft_consensus.cc:493] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:17.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.342008 21923 raft_consensus.cc:3060] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:17.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.348563 21923 raft_consensus.cc:515] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.350503 21923 leader_election.cc:290] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Requested vote from peers 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.351217 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:17.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.351806 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb57a75ce4fc4f34a064173a55fc60fa" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:17.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.352283 21708 raft_consensus.cc:3060] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.352486 21297 leader_election.cc:343] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.353137 21911 tablet_bootstrap.cc:654] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:17.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.360 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:17.360 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:17.360 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:17.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:17.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:17.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:17.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:17.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:17.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:17.361 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:17.361 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:17.361 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:17.361 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:17.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.359860 21918 raft_consensus.cc:493] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.360353 21918 raft_consensus.cc:515] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.362394 21918 leader_election.cc:290] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.364686 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.364615 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.366014 21641 leader_election.cc:343] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.366537 21640 leader_election.cc:343] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.366892 21640 leader_election.cc:304] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6; no voters: 53d7c903ee4c473aa5f0b637189c6e7d, 8e2070f9879f4b97aca892de05842e15
14:26:17.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.367898 21918 raft_consensus.cc:2749] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:17.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.368441 21912 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.368726 21708 raft_consensus.cc:2468] T eb57a75ce4fc4f34a064173a55fc60fa P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53d7c903ee4c473aa5f0b637189c6e7d in term 1.
14:26:17.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.369777 21300 leader_election.cc:304] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 8e2070f9879f4b97aca892de05842e15
14:26:17.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.370837 21923 raft_consensus.cc:2804] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader election won for term 1
14:26:17.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.369055 21912 ts_tablet_manager.cc:1403] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.002s
14:26:17.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.376585 21911 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.377012 21911 ts_tablet_manager.cc:1403] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.001s
14:26:17.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.378762 21424 tablet.cc:2404] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:17.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.381449 21911 raft_consensus.cc:359] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.382121 21911 raft_consensus.cc:385] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.382354 21911 raft_consensus.cc:740] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.382925 21911 consensus_queue.cc:260] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.388993 21912 raft_consensus.cc:359] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.391615 21912 raft_consensus.cc:385] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.391953 21912 raft_consensus.cc:740] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.392136 21913 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.392640 21912 consensus_queue.cc:260] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.402367 21913 ts_tablet_manager.cc:1403] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.034s
14:26:17.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.408756 21923 raft_consensus.cc:697] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 LEADER]: Becoming Leader. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Running, Role: LEADER
14:26:17.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.409762 21923 consensus_queue.cc:237] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.411458 21913 raft_consensus.cc:359] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.412091 21913 raft_consensus.cc:385] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.412357 21913 raft_consensus.cc:740] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.415480 21912 ts_tablet_manager.cc:1434] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
14:26:17.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.416008 21911 ts_tablet_manager.cc:1434] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
14:26:17.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.422659 21911 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:17.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.425282 21913 consensus_queue.cc:260] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.433531 21913 ts_tablet_manager.cc:1434] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
14:26:17.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.435432 21913 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6: Bootstrap starting.
14:26:17.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.440106 21911 tablet_bootstrap.cc:654] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:17.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.446352 21913 tablet_bootstrap.cc:654] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6: Neither blocks nor log segments found. Creating new log.
14:26:17.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.452047 21912 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:17.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.454072 21924 raft_consensus.cc:493] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.454509 21924 raft_consensus.cc:515] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.456283 21924 leader_election.cc:290] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.457676 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c4faa671754965bbf21cbab502f65f" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.459108 21499 leader_election.cc:343] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.460528 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c4faa671754965bbf21cbab502f65f" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.461131 21370 raft_consensus.cc:2468] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 0.
14:26:17.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.462399 21918 raft_consensus.cc:493] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.462771 21918 raft_consensus.cc:515] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.464361 21918 leader_election.cc:290] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.466405 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.466733 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.467247 21566 raft_consensus.cc:2468] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 0.
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.467713 21911 tablet_bootstrap.cc:492] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.467630 21641 leader_election.cc:343] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.468122 21911 ts_tablet_manager.cc:1403] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.468215 21913 tablet_bootstrap.cc:492] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6: No bootstrap required, opened a new log
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.468423 21640 leader_election.cc:304] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 8e2070f9879f4b97aca892de05842e15; no voters: 53d7c903ee4c473aa5f0b637189c6e7d
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.468674 21913 ts_tablet_manager.cc:1403] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.001s
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.468816 21496 leader_election.cc:304] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53d7c903ee4c473aa5f0b637189c6e7d, 8e2070f9879f4b97aca892de05842e15; no voters: 50f3e1b9790e4e1381b0fb94571564d6
14:26:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.469352 21918 raft_consensus.cc:2804] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:17.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.469642 21918 raft_consensus.cc:493] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.469908 21918 raft_consensus.cc:3060] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.470655 21911 raft_consensus.cc:359] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.471248 21911 raft_consensus.cc:385] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.470995 21913 raft_consensus.cc:359] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.471483 21911 raft_consensus.cc:740] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.471563 21913 raft_consensus.cc:385] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.471778 21913 raft_consensus.cc:740] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Initialized, Role: FOLLOWER
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.472044 21911 consensus_queue.cc:260] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.472313 21913 consensus_queue.cc:260] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.473875 21911 ts_tablet_manager.cc:1434] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
14:26:17.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.475008 21924 raft_consensus.cc:2804] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:17.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.475343 21924 raft_consensus.cc:493] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:17.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.475598 21913 ts_tablet_manager.cc:1434] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
14:26:17.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.475628 21924 raft_consensus.cc:3060] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.476151 21911 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:17.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.483853 21911 tablet_bootstrap.cc:654] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:17.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.487522 21924 raft_consensus.cc:515] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.489853 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c4faa671754965bbf21cbab502f65f" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:17.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.490419 21708 raft_consensus.cc:3060] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.490435 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c4faa671754965bbf21cbab502f65f" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:17.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.490898 21370 raft_consensus.cc:3060] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:17.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.496626 21708 raft_consensus.cc:2468] T 64c4faa671754965bbf21cbab502f65f P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 1.
14:26:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.498245 21499 leader_election.cc:304] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 8e2070f9879f4b97aca892de05842e15; no voters: 
14:26:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.500312 21370 raft_consensus.cc:2468] T 64c4faa671754965bbf21cbab502f65f P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 1.
14:26:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.500238 21918 raft_consensus.cc:515] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.501559 21943 raft_consensus.cc:2804] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader election won for term 1
14:26:17.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.502969 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:17.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.504084 21641 leader_election.cc:343] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.504241 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:17.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.503475 21918 leader_election.cc:290] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 election: Requested vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.504920 21566 raft_consensus.cc:3060] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.508293 21911 tablet_bootstrap.cc:492] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.508713 21911 ts_tablet_manager.cc:1403] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
14:26:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.510936 21911 raft_consensus.cc:359] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.511569 21911 raft_consensus.cc:385] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.501868 21013 catalog_manager.cc:5697] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65). New cstate: current_term: 1 leader_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: UNKNOWN } } }
14:26:17.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.511792 21911 raft_consensus.cc:740] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.512385 21911 consensus_queue.cc:260] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.514479 21566 raft_consensus.cc:2468] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 1.
14:26:17.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.514781 21911 ts_tablet_manager.cc:1434] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
14:26:17.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.515738 21911 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d: Bootstrap starting.
14:26:17.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.515893 21640 leader_election.cc:304] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 8e2070f9879f4b97aca892de05842e15; no voters: 53d7c903ee4c473aa5f0b637189c6e7d
14:26:17.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.516994 21918 raft_consensus.cc:2804] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election won for term 1
14:26:17.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.519152 21918 raft_consensus.cc:697] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 LEADER]: Becoming Leader. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Running, Role: LEADER
14:26:17.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.520147 21918 consensus_queue.cc:237] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.521468 21911 tablet_bootstrap.cc:654] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d: Neither blocks nor log segments found. Creating new log.
14:26:17.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.528158 21923 raft_consensus.cc:493] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.528539 21923 raft_consensus.cc:515] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.530300 21923 leader_election.cc:290] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.538375 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.542142 21924 leader_election.cc:290] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 election: Requested vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.544871 21014 catalog_manager.cc:5697] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67). New cstate: current_term: 1 leader_uuid: "50f3e1b9790e4e1381b0fb94571564d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: HEALTHY } } }
14:26:17.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.552886 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b84f2b00f7d4bd483a216521cbc693a" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.553918 21566 raft_consensus.cc:2393] T 7b84f2b00f7d4bd483a216521cbc693a P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53d7c903ee4c473aa5f0b637189c6e7d in current term 1: Already voted for candidate 50f3e1b9790e4e1381b0fb94571564d6 in this term.
14:26:17.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.555408 21297 leader_election.cc:304] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 50f3e1b9790e4e1381b0fb94571564d6, 8e2070f9879f4b97aca892de05842e15
14:26:17.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.556370 21923 raft_consensus.cc:3060] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:17.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.562445 21923 raft_consensus.cc:2749] T 7b84f2b00f7d4bd483a216521cbc693a P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:17.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.585917 21923 raft_consensus.cc:493] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.586453 21923 raft_consensus.cc:515] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.589015 21923 leader_election.cc:290] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.589757 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.589985 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.590451 21708 raft_consensus.cc:2468] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53d7c903ee4c473aa5f0b637189c6e7d in term 0.
14:26:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.591092 21297 leader_election.cc:343] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.591519 21300 leader_election.cc:304] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 8e2070f9879f4b97aca892de05842e15
14:26:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.592878 21923 raft_consensus.cc:2804] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.593274 21923 raft_consensus.cc:493] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.593621 21923 raft_consensus.cc:3060] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.596197 21912 tablet_bootstrap.cc:654] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.600227 21923 raft_consensus.cc:515] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.601734 21923 leader_election.cc:290] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Requested vote from peers 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.602465 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:17.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.602557 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:17.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.602952 21708 raft_consensus.cc:3060] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:17.603498 21297 leader_election.cc:343] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Illegal state: must be running to vote when last-logged opid is not known
14:26:17.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.611414 21708 raft_consensus.cc:2468] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53d7c903ee4c473aa5f0b637189c6e7d in term 1.
14:26:17.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.612849 21300 leader_election.cc:304] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 8e2070f9879f4b97aca892de05842e15
14:26:17.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.614586 21923 raft_consensus.cc:2804] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader election won for term 1
14:26:17.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.615103 21923 raft_consensus.cc:697] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 LEADER]: Becoming Leader. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Running, Role: LEADER
14:26:17.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.615031 21943 raft_consensus.cc:697] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [term 1 LEADER]: Becoming Leader. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Running, Role: LEADER
14:26:17.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.615831 21923 consensus_queue.cc:237] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.618912 21943 consensus_queue.cc:237] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.626 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:17.627 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:17.627 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:17.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.627 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:17.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.631563 21911 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d: No bootstrap required, opened a new log
14:26:17.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.632027 21911 ts_tablet_manager.cc:1403] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent bootstrapping tablet: real 0.116s	user 0.041s	sys 0.048s
14:26:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.635380 21911 raft_consensus.cc:359] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.635990 21911 raft_consensus.cc:385] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.638433 21911 raft_consensus.cc:740] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d7c903ee4c473aa5f0b637189c6e7d, State: Initialized, Role: FOLLOWER
14:26:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.639068 21911 consensus_queue.cc:260] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.641393 21911 ts_tablet_manager.cc:1434] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
14:26:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.641919 21918 raft_consensus.cc:493] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.642369 21918 raft_consensus.cc:515] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.644027 21918 leader_election.cc:290] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.644743 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.645320 21370 raft_consensus.cc:2468] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 0.
14:26:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.645444 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15" is_pre_election: true
14:26:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.645957 21566 raft_consensus.cc:2468] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 0.
14:26:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.646595 21641 leader_election.cc:304] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 
14:26:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.647372 21918 raft_consensus.cc:2804] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.647694 21918 raft_consensus.cc:493] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.647969 21918 raft_consensus.cc:3060] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.657382 21918 raft_consensus.cc:515] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.660389 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:17.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.660904 21370 raft_consensus.cc:3060] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:17.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.666541 21918 leader_election.cc:290] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 election: Requested vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167)
14:26:17.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.667655 21566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d550c478645c4a86bb681c15c1b56" candidate_uuid: "50f3e1b9790e4e1381b0fb94571564d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2070f9879f4b97aca892de05842e15"
14:26:17.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.668162 21566 raft_consensus.cc:3060] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.671888 21370 raft_consensus.cc:2468] T a48d550c478645c4a86bb681c15c1b56 P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 1.
14:26:17.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.672982 21641 leader_election.cc:304] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d; no voters: 
14:26:17.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.675480 21918 raft_consensus.cc:2804] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election won for term 1
14:26:17.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.675873 21918 raft_consensus.cc:697] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 LEADER]: Becoming Leader. State: Replica: 50f3e1b9790e4e1381b0fb94571564d6, State: Running, Role: LEADER
14:26:17.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.676614 21918 consensus_queue.cc:237] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.693783 21566 raft_consensus.cc:2468] T a48d550c478645c4a86bb681c15c1b56 P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f3e1b9790e4e1381b0fb94571564d6 in term 1.
14:26:17.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.700141 21912 tablet_bootstrap.cc:492] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.700623 21912 ts_tablet_manager.cc:1403] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.249s	user 0.009s	sys 0.010s
14:26:17.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.703440 21912 raft_consensus.cc:359] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.704101 21912 raft_consensus.cc:385] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.704368 21912 raft_consensus.cc:740] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.705003 21912 consensus_queue.cc:260] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.707617 21912 ts_tablet_manager.cc:1434] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
14:26:17.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.708721 21912 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.709502 21943 raft_consensus.cc:493] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.709918 21943 raft_consensus.cc:515] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.733716 21013 catalog_manager.cc:5697] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65). New cstate: current_term: 1 leader_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: UNKNOWN } } }
14:26:17.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.740908 21943 leader_election.cc:290] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.742784 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.743505 21708 raft_consensus.cc:2393] T ea76dbfe58b54be491e3904c3b089ecb P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e2070f9879f4b97aca892de05842e15 in current term 1: Already voted for candidate 53d7c903ee4c473aa5f0b637189c6e7d in this term.
14:26:17.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.756161 21912 tablet_bootstrap.cc:654] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.755999 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea76dbfe58b54be491e3904c3b089ecb" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:17.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.761690 21496 leader_election.cc:304] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e2070f9879f4b97aca892de05842e15; no voters: 50f3e1b9790e4e1381b0fb94571564d6, 53d7c903ee4c473aa5f0b637189c6e7d
14:26:17.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.762760 21943 raft_consensus.cc:3060] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.776238 21943 raft_consensus.cc:2749] T ea76dbfe58b54be491e3904c3b089ecb P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:26:17.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.775926 21012 catalog_manager.cc:5697] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e2070f9879f4b97aca892de05842e15 (127.20.103.66). New cstate: current_term: 1 leader_uuid: "8e2070f9879f4b97aca892de05842e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: UNKNOWN } } }
14:26:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.781236 21014 catalog_manager.cc:5697] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67). New cstate: current_term: 1 leader_uuid: "50f3e1b9790e4e1381b0fb94571564d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: HEALTHY } } }
14:26:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.801787 21912 tablet_bootstrap.cc:492] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.806329 21912 ts_tablet_manager.cc:1403] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.004s
14:26:17.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.810708 21912 raft_consensus.cc:359] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.818125 21912 raft_consensus.cc:385] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.818509 21912 raft_consensus.cc:740] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.819890 21912 consensus_queue.cc:260] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.825678 21912 ts_tablet_manager.cc:1434] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
14:26:17.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.829144 21912 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15: Bootstrap starting.
14:26:17.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.850270 21912 tablet_bootstrap.cc:654] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15: Neither blocks nor log segments found. Creating new log.
14:26:17.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.872895 21912 tablet_bootstrap.cc:492] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15: No bootstrap required, opened a new log
14:26:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.873327 21912 ts_tablet_manager.cc:1403] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
14:26:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.876199 21912 raft_consensus.cc:359] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.878434 21912 raft_consensus.cc:385] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:17.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.878809 21912 raft_consensus.cc:740] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Initialized, Role: FOLLOWER
14:26:17.886 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:17.886 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:17.886 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:17.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:17.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:17.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:17.888 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:17.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.886957 21912 consensus_queue.cc:260] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:17.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.892402 21912 ts_tablet_manager.cc:1434] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
14:26:17.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.924990 21923 consensus_queue.cc:1048] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:17.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.957891 21566 raft_consensus.cc:3060] T eb57a75ce4fc4f34a064173a55fc60fa P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:17.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.968559 21937 consensus_queue.cc:1048] T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.999873 21943 raft_consensus.cc:493] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:18.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:17.999913 21937 consensus_queue.cc:1048] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.000325 21943 raft_consensus.cc:515] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:18.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.001880 21943 leader_election.cc:290] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:18.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.003079 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" is_pre_election: true
14:26:18.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.003639 21370 raft_consensus.cc:2468] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 0.
14:26:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.004082 21707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6" is_pre_election: true
14:26:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.004671 21707 raft_consensus.cc:2468] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 0.
14:26:18.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.006510 21496 leader_election.cc:304] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53d7c903ee4c473aa5f0b637189c6e7d, 8e2070f9879f4b97aca892de05842e15; no voters: 
14:26:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.007337 21944 raft_consensus.cc:2804] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.007694 21944 raft_consensus.cc:493] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.008113 21944 raft_consensus.cc:3060] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 0 FOLLOWER]: Advancing to term 1
14:26:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.013604 21943 consensus_queue.cc:1048] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.017663 21944 raft_consensus.cc:515] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:18.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.020674 21708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f3e1b9790e4e1381b0fb94571564d6"
14:26:18.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.021165 21708 raft_consensus.cc:3060] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 0 FOLLOWER]: Advancing to term 1
14:26:18.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.023929 21370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050aee52c0944bd8b2f5766c38016439" candidate_uuid: "8e2070f9879f4b97aca892de05842e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d7c903ee4c473aa5f0b637189c6e7d"
14:26:18.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.024593 21370 raft_consensus.cc:3060] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 0 FOLLOWER]: Advancing to term 1
14:26:18.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.046715 21708 raft_consensus.cc:2468] T 050aee52c0944bd8b2f5766c38016439 P 50f3e1b9790e4e1381b0fb94571564d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 1.
14:26:18.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.047843 21499 leader_election.cc:304] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f3e1b9790e4e1381b0fb94571564d6, 8e2070f9879f4b97aca892de05842e15; no voters: 
14:26:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.048667 21924 raft_consensus.cc:2804] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 1 FOLLOWER]: Leader election won for term 1
14:26:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.049041 21924 raft_consensus.cc:697] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [term 1 LEADER]: Becoming Leader. State: Replica: 8e2070f9879f4b97aca892de05842e15, State: Running, Role: LEADER
14:26:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.049712 21924 consensus_queue.cc:237] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } }
14:26:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.050968 21918 consensus_queue.cc:1048] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.052949 21943 consensus_queue.cc:1048] T 64c4faa671754965bbf21cbab502f65f P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.055891 21944 leader_election.cc:290] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [CANDIDATE]: Term 1 election: Requested vote from peers 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757), 50f3e1b9790e4e1381b0fb94571564d6 (127.20.103.67:35767)
14:26:18.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.075783 21923 consensus_queue.cc:1048] T ea76dbfe58b54be491e3904c3b089ecb P 53d7c903ee4c473aa5f0b637189c6e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.086520 21919 consensus_queue.cc:1048] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.137728 21370 raft_consensus.cc:2468] T 050aee52c0944bd8b2f5766c38016439 P 53d7c903ee4c473aa5f0b637189c6e7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e2070f9879f4b97aca892de05842e15 in term 1.
14:26:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:18.142400 21496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.103.65:40757, user_credentials={real_user=slave}} blocked reactor thread for 92883.9us
14:26:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.143961 21013 catalog_manager.cc:5697] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e2070f9879f4b97aca892de05842e15 (127.20.103.66). New cstate: current_term: 1 leader_uuid: "8e2070f9879f4b97aca892de05842e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 } health_report { overall_health: UNKNOWN } } }
14:26:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.147495 21918 consensus_queue.cc:1048] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2070f9879f4b97aca892de05842e15" member_type: VOTER last_known_addr { host: "127.20.103.66" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.164805 21918 consensus_queue.cc:1048] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:18.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.330 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:18.331 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:18.331 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:18.331 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.331 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.331 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.331 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.331 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.331 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.331 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:18.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.420 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:18.421 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:18.421 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:18.421 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:18.421 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:18.421 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:18.421 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:18.421 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:18.421 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:18.421 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:18.421 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:18.421 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:18.422 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:18.550 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:18.550 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:18.550 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:18.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:18.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:18.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:18.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:18.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:18.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:18.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:18.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:18.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:18.551 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:18.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:18.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:18.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:18.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.565 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.565 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.565 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:18.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.589685 21943 consensus_queue.cc:1048] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f3e1b9790e4e1381b0fb94571564d6" member_type: VOTER last_known_addr { host: "127.20.103.67" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:18.611852 21943 consensus_queue.cc:1048] T 050aee52c0944bd8b2f5766c38016439 P 8e2070f9879f4b97aca892de05842e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d7c903ee4c473aa5f0b637189c6e7d" member_type: VOTER last_known_addr { host: "127.20.103.65" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:18.664 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:18.664 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:18.664 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:18.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.666 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:18.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.680 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:18.680 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:18.680 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:18.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:18.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:18.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:18.681 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:18.686 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:18.686 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:18.687 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:18.687 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:18.687 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:18.687 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:18.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:18.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:18.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:18.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:18.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:18.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:18.687 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:18.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.773 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.62:34807(127.19.148.62:34807)] disconnecting while in state READY
14:26:18.773 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.61:37523(127.19.148.61:37523)] disconnecting while in state READY
14:26:18.773 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.60:37365(127.19.148.60:37365)] disconnecting while in state READY
14:26:18.774 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.148.62:34807(127.19.148.62:34807)] handling channelInactive
14:26:18.774 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state READY due to: connection closed
14:26:18.775 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.148.61:37523(127.19.148.61:37523)] handling channelInactive
14:26:18.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state READY due to: connection closed
14:26:18.775 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:18.779 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:26:18.780 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:26:18.794 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.148.60:37365(127.19.148.60:37365)] handling channelInactive
14:26:18.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state READY due to: connection closed
14:26:18.794 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state READY
14:26:18.794 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
14:26:18.794 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state READY
14:26:18.795 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state READY
14:26:18.795 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:18.795 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:18.795 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:18.795 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:18.795 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:18.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:18.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:18.795 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:18.796 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:18.796 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:18.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:18.796 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:18.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:18.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:18.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:18.796 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:18.796 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:18.796 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:18.797 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:18.797 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:26:18.802 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:18.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:18.802 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-0
14:26:18.804 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:26:18.804 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:26:18.804 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:26:18.805 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:26:18.805 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:26:18.805 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:26:18.810 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:26:18.810 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:26:18.810 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:26:18.811 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:26:18.811 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:26:18.811 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:26:18.811 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:26:18.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:18.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:19.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:19.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:19.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:19.058 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:19.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:19.058 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:19.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:19.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:19.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:19.059 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:19.059 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:19.059 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:19.059 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:26:19.105 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:26:19.105 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:26:19.106 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:26:19.117 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:26:19.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:19.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:19.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:19.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.125 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.125 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.125 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.126 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:19.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.195 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.220 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:19.220 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:19.220 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:19.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:19.305 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:19.306 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:19.306 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:19.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.306 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.307 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:19.322 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:19.323 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:19.323 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:19.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:19.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:19.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:19.323 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:19.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:19.323 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:19.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:19.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:19.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:19.323 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:19.360 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.360 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.411 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:19.412 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:19.412 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:19.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:19.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:19.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:19.472 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:19.473 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:19.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:19.473 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:19.473 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:19.473 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:19.473 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:19.473 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:19.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:19.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:19.474 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:19.506 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:19.506 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:19.506 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:19.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.507 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.507 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:19.620 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:19.621 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:19.621 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:19.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.622 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.623 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.623 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:19.631 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:19.631 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:19.632 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:19.632 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.632 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.632 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:19.632 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.632 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.632 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:19.632 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.632 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.632 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:19.632 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:19.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.695 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.810 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
14:26:19.860 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.860 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:19.900 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:19.900 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:19.900 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:19.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.901 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:19.901 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:19.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.901 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:19.901 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:19.978 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:26:19.989 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:26:20.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:20.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:20.004 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:20.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:20.016 [INFO - flink-metrics-6] (Slf4jLogger.scala:117) Slf4jLogger started
14:26:20.026 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:26:20.038 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:26:20.047 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:26:20.048 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:26:20.048 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:26:20.048 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:26:20.048 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:26:20.048 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:26:20.049 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:26:20.049 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:26:20.049 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:20.049 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:20.049 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:20.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:20.049 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:26:20.049 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:20.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:20.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:20.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:20.050 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:20.050 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:26:20.050 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:20.050 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:20.050 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:20.050 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:26:20.050 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:20.050 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:26:20.050 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:26:20.050 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:26:20.050 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:26:20.050 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:26:20.051 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:26:20.051 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:26:20.051 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:26:20.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28407), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [18ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [27ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [55ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [55ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [74ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [782ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1642ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2503ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5980ms] refreshing cache from master, [5980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5981ms] too many traces: truncated at 100 traces, deferred=Deferred@903987342(state=PENDING, result=null, callback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559), errback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559)))
14:26:20.051 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:26:20.051 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:26:20.052 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:26:20.052 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:26:20.052 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:26:20.052 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:26:20.052 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_3db2cf7ed67c2c218b8abcc739251a9b/blobStorage
14:26:20.052 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28407), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [18ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [27ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [55ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [55ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [74ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [782ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1642ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2503ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5980ms] refreshing cache from master, [5980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5981ms] too many traces: truncated at 100 traces, deferred=Deferred@903987342(state=PENDING, result=null, callback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559), errback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:20.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:26:20.053 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:35473 - max concurrent requests: 50 - max backlog: 1000
14:26:20.054 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3db2cf7ed67c2c218b8abcc739251a9b/blobStorage
14:26:20.055 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:26:20.056 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28407), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [18ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [27ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [55ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [55ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [74ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [101ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [782ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1642ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [2503ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [5980ms] refreshing cache from master, [5980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [5981ms] too many traces: truncated at 100 traces, deferred=Deferred@903987342(state=PENDING, result=null, callback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559), errback=(continuation of Deferred@1422211716 after retry RPC after error@876803331) -> (continuation of Deferred@632308489 after retry RPC after error@510526081) -> (continuation of Deferred@1661082322 after retry RPC after error@1087045980) -> (continuation of Deferred@1732557383 after retry RPC after error@164681252) -> (continuation of Deferred@2063042886 after retry RPC after error@1655617189) -> (continuation of Deferred@553299509 after retry RPC after error@789851640) -> (continuation of Deferred@1777282277 after retry RPC after error@2128848099) -> (continuation of Deferred@186459660 after retry RPC after error@99135866) -> (continuation of Deferred@359673126 after retry RPC after error@1993820119) -> (continuation of Deferred@337130055 after retry RPC after error@1421554399) -> (continuation of Deferred@1085680755 after retry RPC after error@202580557) -> (continuation of Deferred@1498198914 after retry RPC after error@1416388542) -> (continuation of Deferred@633877748 after retry RPC after error@819755850) -> (continuation of Deferred@204476016 after retry RPC after error@982987239) -> (continuation of Deferred@1587334613 after retry RPC after error@222948199) -> (continuation of Deferred@25573168 after retry RPC after error@35464942) -> (continuation of Deferred@978821405 after retry RPC after error@2022139875) -> (continuation of Deferred@1216934004 after retry RPC after error@600413661) -> (continuation of Deferred@605132784 after retry RPC after error@1735021806) -> (continuation of Deferred@1760432935 after retry RPC after error@124126362) -> (continuation of Deferred@794865041 after retry RPC after error@437797303) -> (continuation of Deferred@41357048 after retry RPC after error@897747192) -> (continuation of Deferred@530884604 after retry RPC after error@1206470726) -> (continuation of Deferred@2111016589 after retry RPC after error@1547111559)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:20.057 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:20.058 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:26:20.058 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RUNNING to RESTARTING.
14:26:20.058 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
14:26:20.062 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3db2cf7ed67c2c218b8abcc739251a9b/blobStorage
14:26:20.070 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:26:20.070 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 89242725-cc0d-4a24-9517-dcaa815e9eed
14:26:20.071 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 34 GB (70.83% usable)
14:26:20.072 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-438dd839-8c88-482e-9830-a6fb56166655
14:26:20.073 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-9b7cd147-34a6-4867-b5c9-a950f86c839d
14:26:20.114 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:20.115 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:20.115 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:20.115 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.115 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.115 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.115 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.116 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:20.144 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:26:20.144 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:26:20.144 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:26:20.145 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:26:20.145 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:26:20.147 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_20 .
14:26:20.152 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
14:26:20.152 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-135c937b-bbbf-42fb-a365-6df6f853f0d0
14:26:20.154 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:26:20.155 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:26:20.163 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:26:20.163 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:26:20.170 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:36135
14:26:20.171 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:26:20.171 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:36135 was granted leadership with leaderSessionID=cf095dc7-97d6-4a0a-a9b3-e0cfb03ab99f
14:26:20.171 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:36135 , session=cf095dc7-97d6-4a0a-a9b3-e0cfb03ab99f
14:26:20.172 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:26:20.173 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:26:20.173 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:26:20.173 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 9fbd2c72-b390-4aaa-9d62-212e057d927b. Creating new DispatcherLeaderProcess.
14:26:20.173 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:26:20.173 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:26:20.174 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:26:20.174 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:26:20.174 [INFO - pool-397-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id ae628990-237e-478a-b878-09e9c1b74c35.
14:26:20.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.175 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:20.175 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:20.175 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:20.175 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.175 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.175 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.175 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.175 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.175 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.175 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:20.176 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_21 .
14:26:20.177 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:20.177 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:20.177 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:20.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:20.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:20.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:20.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:20.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:20.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:20.179 [INFO - pool-397-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_22 .
14:26:20.179 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:20.180 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:20.180 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:20.180 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:20.182 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_21 , session=9fbd2c72-b390-4aaa-9d62-212e057d927b
14:26:20.182 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
14:26:20.183 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:26:20.183 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:26:20.183 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:26:20.183 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:26:20.183 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_22 , session=ae628990-237e-478a-b878-09e9c1b74c35
14:26:20.184 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(b87809e9c1b74c35ae628990237e478a).
14:26:20.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:20.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:20.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:20.209 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.209 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.209 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.209 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.209 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.209 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.209 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.209 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.209 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.209 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:20.221 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:26:20.227 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID 89242725-cc0d-4a24-9517-dcaa815e9eed (pekko://flink/user/rpc/taskmanager_20) at ResourceManager
14:26:20.227 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_22 under registration id 7e83b1461967bf47453a4eaf57aefd04.
14:26:20.228 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (4459c5bc8e668403214dd967e9f85899).
14:26:20.228 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (4459c5bc8e668403214dd967e9f85899).
14:26:20.228 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-4459c5bc8e668403214dd967e9f85899'.
14:26:20.228 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor 89242725-cc0d-4a24-9517-dcaa815e9eed under 7e83b1461967bf47453a4eaf57aefd04 at the slot manager.
14:26:20.228 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 4459c5bc8e668403214dd967e9f85899 was granted leadership with leader id 5aa532e8-5b66-499e-8682-ae5659280d0a. Creating new JobMasterServiceProcess.
14:26:20.231 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_23 .
14:26:20.235 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (4459c5bc8e668403214dd967e9f85899).
14:26:20.236 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (4459c5bc8e668403214dd967e9f85899).
14:26:20.236 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 06977d9d21d42e3d93dc9439abe67e59 for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.237 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (4459c5bc8e668403214dd967e9f85899).
14:26:20.237 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:26:20.238 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:26:20.238 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@176dad19
14:26:20.238 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:20.238 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:20.240 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:26:20.240 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@45ddbed5 for Flink Streaming Job (4459c5bc8e668403214dd967e9f85899).
14:26:20.240 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_23 , session=5aa532e8-5b66-499e-8682-ae5659280d0a
14:26:20.241 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (4459c5bc8e668403214dd967e9f85899) under job master id 8682ae5659280d0a5aa532e85b66499e.
14:26:20.241 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:20.243 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.243 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:26:20.244 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4459c5bc8e668403214dd967e9f85899) switched from state CREATED to RUNNING.
14:26:20.247 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:26:20.247 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:20.247 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:26:20.248 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:20.248 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:26:20.248 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:26:20.248 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(b87809e9c1b74c35ae628990237e478a)
14:26:20.248 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.148.62:34807(127.19.148.62:34807)] Successfully connected to peer
14:26:20.249 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:20.250 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:26:20.250 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.148.60:37365(127.19.148.60:37365)] Successfully connected to peer
14:26:20.250 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 8682ae5659280d0a5aa532e85b66499e@pekko://flink/user/rpc/jobmanager_23 for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.251 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.148.61:37523(127.19.148.61:37523)] Successfully connected to peer
14:26:20.264 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.60
14:26:20.268 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 8682ae5659280d0a5aa532e85b66499e@pekko://flink/user/rpc/jobmanager_23 for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.275 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.278 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x380482e8, L:/127.0.0.1:53820 - R:/127.19.148.60:37365] using SASL/PLAIN
14:26:20.278 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.62
14:26:20.279 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b87809e9c1b74c35ae628990237e478a.
14:26:20.279 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:20.284 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:20.285 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:20.285 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:20.286 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.287 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.287 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=40), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [40ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: OK, deferred=null) after lookup
14:26:20.289 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x70f1c3b0, L:/127.0.0.1:58418 - R:/127.19.148.62:34807] using SASL/PLAIN
14:26:20.292 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.61
14:26:20.292 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:20.293 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 4459c5bc8e668403214dd967e9f85899
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 89242725-cc0d-4a24-9517-dcaa815e9eed
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:26:20.294 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 98d9e81a5cb56b91733c38b892d9e689 from 89242725-cc0d-4a24-9517-dcaa815e9eed for job 4459c5bc8e668403214dd967e9f85899 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.294 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 45dbfbea3548d21c9096d14783aaf54e from 89242725-cc0d-4a24-9517-dcaa815e9eed for job 4459c5bc8e668403214dd967e9f85899 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.294 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 98d9e81a5cb56b91733c38b892d9e689 for job 4459c5bc8e668403214dd967e9f85899 from resource manager with leader id b87809e9c1b74c35ae628990237e478a.
14:26:20.295 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 98d9e81a5cb56b91733c38b892d9e689 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.295 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1fa96300ce4695632939067e99e6b6ed from 89242725-cc0d-4a24-9517-dcaa815e9eed for job 4459c5bc8e668403214dd967e9f85899 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.295 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 23791360103b5f0d8bad554d0e3cd2c7 from 89242725-cc0d-4a24-9517-dcaa815e9eed for job 4459c5bc8e668403214dd967e9f85899 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.299 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.300 [DEBUG - main] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.301 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job 4459c5bc8e668403214dd967e9f85899 for job leader monitoring.
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.301 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:20.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.301 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 45dbfbea3548d21c9096d14783aaf54e for job 4459c5bc8e668403214dd967e9f85899 from resource manager with leader id b87809e9c1b74c35ae628990237e478a.
14:26:20.301 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.302 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_23 with leader id 5aa532e8-5b66-499e-8682-ae5659280d0a.
14:26:20.303 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:20.303 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:26:20.301 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 45dbfbea3548d21c9096d14783aaf54e with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.304 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 1fa96300ce4695632939067e99e6b6ed for job 4459c5bc8e668403214dd967e9f85899 from resource manager with leader id b87809e9c1b74c35ae628990237e478a.
14:26:20.304 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 1fa96300ce4695632939067e99e6b6ed with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.304 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 23791360103b5f0d8bad554d0e3cd2c7 for job 4459c5bc8e668403214dd967e9f85899 from resource manager with leader id b87809e9c1b74c35ae628990237e478a.
14:26:20.304 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 23791360103b5f0d8bad554d0e3cd2c7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:26:20.306 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_23 for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.306 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.306 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 4459c5bc8e668403214dd967e9f85899.
14:26:20.307 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:26:20.307 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 45dbfbea3548d21c9096d14783aaf54e
14:26:20.308 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 45dbfbea3548d21c9096d14783aaf54e.
14:26:20.309 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.310 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:26:20.310 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 4459c5bc8e668403214dd967e9f85899
14:26:20.311 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 45dbfbea3548d21c9096d14783aaf54e.
14:26:20.311 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.313 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc818d476, L:/127.0.0.1:48612 - R:/127.19.148.61:37523] using SASL/PLAIN
14:26:20.316 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:20.322 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:20.318 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1314cb76, L:/127.0.0.1:51070 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:20.318 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:20.323 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:20.323 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:20.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.323 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:20.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.323 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:20.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:20.323 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:20.329 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:20.329 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:26:20.329 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 1fa96300ce4695632939067e99e6b6ed
14:26:20.330 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.330 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=48), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [46ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:20.331 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.332 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:26:20.332 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 98d9e81a5cb56b91733c38b892d9e689
14:26:20.333 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.334 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x37ce7a24, L:/127.0.0.1:42150 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.339 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.20.103.125:34309, [4ms] Sub RPC GetTableLocations: received response from server master-127.20.103.125:34309: OK, deferred=null)) after lookup
14:26:20.340 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] connecting to peer
14:26:20.340 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.343 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xaf3a3788, L:/127.0.0.1:41594 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:20.345 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:26:20.345 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 23791360103b5f0d8bad554d0e3cd2c7
14:26:20.356 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.362 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1fa96300ce4695632939067e99e6b6ed.
14:26:20.362 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] Successfully connected to peer
14:26:20.364 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 1fa96300ce4695632939067e99e6b6ed.
14:26:20.365 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:26:20.365 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:26:20.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7999de06
14:26:20.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:20.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:20.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:26:20.368 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:26:20.370 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 98d9e81a5cb56b91733c38b892d9e689.
14:26:20.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:26:20.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:26:20.376 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 98d9e81a5cb56b91733c38b892d9e689.
14:26:20.376 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ae21f35
14:26:20.376 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:20.377 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:20.377 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:26:20.378 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:26:20.378 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f3302
14:26:20.382 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.383 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.385 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 23791360103b5f0d8bad554d0e3cd2c7.
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b4e6a95
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:26:20.388 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:26:20.387 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6cc2004e
14:26:20.388 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xac3bc753, L:/127.0.0.1:43186 - R:/127.20.103.67:35767] using TOKEN/null
14:26:20.389 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 23791360103b5f0d8bad554d0e3cd2c7.
14:26:20.390 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.394 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:20.395 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 45dbfbea3548d21c9096d14783aaf54e.
14:26:20.395 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1fa96300ce4695632939067e99e6b6ed.
14:26:20.395 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 98d9e81a5cb56b91733c38b892d9e689.
14:26:20.395 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 23791360103b5f0d8bad554d0e3cd2c7.
14:26:20.397 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@778233dd
14:26:20.397 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:26:20.397 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:26:20.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65a19128
14:26:20.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:20.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:20.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:26:20.398 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:26:20.402 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4b8c97c
14:26:20.404 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.405 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.410 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:20.410 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:20.410 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:20.413 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:20.413 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:20.413 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:20.416 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:20.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:20.417 [DEBUG - main] (Connection.java:748) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] connecting to peer
14:26:20.420 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.423 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb4d81511, L:/127.0.0.1:42166 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:20.423 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:20.430 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:20.431 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:20.438 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:20.438 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:20.441 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:20.444 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:20.447 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.449 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8c8212d9, L:/127.0.0.1:51074 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:20.451 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.452 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:20.454 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:20.455 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:20.456 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:20.458 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.459 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=75), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [33ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.124:41795: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:20.462 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa27b9f4f, L:/127.0.0.1:41596 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:20.463 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.466 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:20.466 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.466 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c2517e7
14:26:20.466 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:26:20.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:26:20.474 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.475 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc2451447, L:/127.0.0.1:51086 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:20.477 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x92770bcf, L:/127.0.0.1:42172 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:20.478 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:20.479 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.479 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=74), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [48ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:20.480 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:20.482 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.483 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:20.485 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.485 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@90e178a
14:26:20.484 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] Successfully connected to peer
14:26:20.486 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:26:20.486 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:26:20.488 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:20.489 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:20.492 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:20.495 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.495 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.497 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:20.498 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:20.500 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x80f78255, L:/127.0.0.1:51092 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:20.502 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.503 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:20.506 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd5d4b05c, L:/127.0.0.1:42186 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:20.507 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.103.125:34309(127.20.103.125:34309)] Successfully connected to peer
14:26:20.507 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe5d3424d, L:/127.0.0.1:41600 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:20.508 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.125
14:26:20.510 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.510 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=105), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [87ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:20.514 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.515 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:20.517 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.103.124:41795(127.20.103.124:41795)] Successfully connected to peer
14:26:20.518 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.103.126:39327(127.20.103.126:39327)] Successfully connected to peer
14:26:20.519 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:26:20.519 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='de9710b85afd2503e4c09583b96404e75d05e714c8ba23b05828917dd702b3fb'}]
14:26:20.521 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.524 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.525 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:26:20.526 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.526 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1dd4e3a6
14:26:20.530 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.126
14:26:20.532 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.533 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.103.124
14:26:20.536 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x290edd87, L:/127.0.0.1:56218 - R:/127.20.103.65:40757] using TOKEN/null
14:26:20.543 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.543 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299997, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:20.547 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe4342f60, L:/127.0.0.1:51104 - R:/127.20.103.125:34309] using SASL/PLAIN
14:26:20.550 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:26:20.551 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=160), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.125:34309, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.124:41795, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.103.126:39327, [137ms] Sub RPC ConnectToMaster: received response from server master-127.20.103.125:34309: OK, deferred=null) after lookup
14:26:20.553 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd090cb94, L:/127.0.0.1:41612 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:20.554 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.558 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.558 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:20.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:26:20.560 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c3d05ca7e13634a5d1ac402f8ed9ae74b35057b62a2078ce25732eea185be739'}]
14:26:20.561 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.563 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:26:20.564 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299997, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:20.565 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.565 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:20.565 [DEBUG - main] (Connection.java:748) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] connecting to peer
14:26:20.569 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:20.569 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4857bbca
14:26:20.570 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:26:20.571 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.571 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:26:20.572 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.574 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:26:20.574 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:26:20.575 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5b47de8d, L:/127.0.0.1:42188 - R:/127.20.103.124:41795] using SASL/PLAIN
14:26:20.575 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0ab30a0f, L:/127.0.0.1:41614 - R:/127.20.103.126:39327] using SASL/PLAIN
14:26:20.583 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:26:20.584 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:26:20.584 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:26:20.584 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:26:20.586 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7a4a463341324c4d4a011644d09c67e70d6a4d04417ab7309b36b35f5959dc80'}]
14:26:20.587 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.601 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:20.607 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] Successfully connected to peer
14:26:20.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:26:20.641 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:26:20.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8bb3ee0259bcb44ab98342d8da200c0173391c3922e94053743f9e4071ef89e1'}]
14:26:20.643 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.647 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:26:20.651 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:20.651 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:20.651 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:20.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.653 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:20.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114380658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:20.667 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:20.667 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:20.667 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:20.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:20.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:20.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:20.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:20.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:20.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:20.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:20.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:20.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:20.668 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:20.671 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:20.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.694 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:20.695 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.701 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:26:20.702 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:20.728 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x176af4d6, L:/127.0.0.1:50866 - R:/127.20.103.66:35167] using TOKEN/null
14:26:20.742 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:20.743 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:20.743 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:20.744 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:20.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:20.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:20.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:20.749 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:20.752 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:20.754 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:20.765 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.766 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:20.771 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.771 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:20.774 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:20.783 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 4459c5bc8e668403214dd967e9f85899 (5026 bytes, checkpointDuration=125 ms, finalizationTime=0 ms).
14:26:20.784 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:26:20.787 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:20.794 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:20.801 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:20.807 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:20.807 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.810 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.820 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.820 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:20.828 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3bda9b12, L:/127.0.0.1:39720 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:20.836 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:20.844 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd6695f11, L:/127.0.0.1:39716 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:20.850 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.854 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:20.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.858 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc73360bd, L:/127.0.0.1:39740 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:20.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:20.866 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:20.866 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:20.866 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:20.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:20.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:20.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:20.867 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:20.873 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.873 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8bb3ee0259bcb44ab98342d8da200c0173391c3922e94053743f9e4071ef89e1]
14:26:20.874 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:26:20.879 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.879 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:20.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.882 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.883 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8bb3ee0259bcb44ab98342d8da200c0173391c3922e94053743f9e4071ef89e1]
14:26:20.885 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8bb3ee0259bcb44ab98342d8da200c0173391c3922e94053743f9e4071ef89e1 finished by subtask 1; deferring removal (restored in pending)
14:26:20.886 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.887 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:20.887 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.887 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.887 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.887 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.887 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.888 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.888 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.888 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.888 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:26:20.888 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:26:20.888 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:20.889 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:20.889 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:20.890 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e295afb429588265e88d1d4eceb64e9fadee1b7c51235fb44df4c720515d462d'}]
14:26:20.891 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.892 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.892 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:20.899 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.899 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:20.903 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa1df2c34, L:/127.0.0.1:39736 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:20.906 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.906 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:20.914 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:20.914 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:20.915 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:26:20.915 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:26:20.916 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.916 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:20.921 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:26:20.923 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:20.946 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.947 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [c3d05ca7e13634a5d1ac402f8ed9ae74b35057b62a2078ce25732eea185be739]
14:26:20.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c3d05ca7e13634a5d1ac402f8ed9ae74b35057b62a2078ce25732eea185be739]
14:26:20.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:26:20.947 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:26:20.948 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c3d05ca7e13634a5d1ac402f8ed9ae74b35057b62a2078ce25732eea185be739 finished by subtask 3; deferring removal (restored in pending)
14:26:20.949 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:20.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:20.950 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c494d75fb52f44c94e023be6a1c68519f4f1ebabe63568b6fbb1e2d68e4dc23c'}]
14:26:20.951 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:20.956 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:20.967 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:26:20.967 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:20.968 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.968 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [de9710b85afd2503e4c09583b96404e75d05e714c8ba23b05828917dd702b3fb]
14:26:20.969 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:26:20.971 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [de9710b85afd2503e4c09583b96404e75d05e714c8ba23b05828917dd702b3fb]
14:26:20.972 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.972 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:20.975 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split de9710b85afd2503e4c09583b96404e75d05e714c8ba23b05828917dd702b3fb finished by subtask 0; deferring removal (restored in pending)
14:26:20.983 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.983 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.983 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [7a4a463341324c4d4a011644d09c67e70d6a4d04417ab7309b36b35f5959dc80]
14:26:20.983 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:20.984 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.985 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:20.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:20.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7a4a463341324c4d4a011644d09c67e70d6a4d04417ab7309b36b35f5959dc80]
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:26:20.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:26:20.986 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:20.986 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.987 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.988 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7a4a463341324c4d4a011644d09c67e70d6a4d04417ab7309b36b35f5959dc80 finished by subtask 2; deferring removal (restored in pending)
14:26:20.986 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:20.989 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:26:20.989 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:26:20.989 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:20.989 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:20.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:20.991 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.991 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:20.997 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:20.997 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.004 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.004 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.011 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.011 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.033 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:21.039 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:21.060 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:21.068 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.068 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.075 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.075 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.079 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.079 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.088 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.088 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.096 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.096 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.103 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.103 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.121 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.129 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3afca241, L:/127.0.0.1:39746 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:21.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114381158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:21.164 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.164 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.171 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@572fef36, flushNotification=Deferred@1293813254(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:26:21.172 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] connecting to peer
14:26:21.172 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@170e80c6, flushNotification=Deferred@1186626103(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:26:21.173 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] connecting to peer
14:26:21.173 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:21.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:21.173 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6e171680, flushNotification=Deferred@611546413(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:26:21.174 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:26:21.174 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] connecting to peer
14:26:21.175 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:26:21.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.195 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.195 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.205 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.205 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:21.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:21.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:21.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:21.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:21.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:21.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:21.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:21.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:21.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:21.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:21.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:21.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:21.238 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.238 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [e295afb429588265e88d1d4eceb64e9fadee1b7c51235fb44df4c720515d462d]
14:26:21.259 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.259 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.270 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.270 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.277 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] Successfully connected to peer
14:26:21.285 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:21.288 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:21.304 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:21.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:21.305 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:26:21.305 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:26:21.306 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.313 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2d9803af, L:/127.0.0.1:39750 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:21.327 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.328 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.328 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:21.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:21.328 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:21.328 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:26:21.330 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] Successfully connected to peer
14:26:21.334 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.334 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.339 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.339 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.346 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.346 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.353 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.353 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.359 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287252501491712001) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.359 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [c494d75fb52f44c94e023be6a1c68519f4f1ebabe63568b6fbb1e2d68e4dc23c]
14:26:21.360 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:26:21.360 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.360 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.362 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c494d75fb52f44c94e023be6a1c68519f4f1ebabe63568b6fbb1e2d68e4dc23c]
14:26:21.363 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:26:21.363 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:26:21.363 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:21.363 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c494d75fb52f44c94e023be6a1c68519f4f1ebabe63568b6fbb1e2d68e4dc23c finished by subtask 3; deferring removal (restored in pending)
14:26:21.365 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:21.365 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] Successfully connected to peer
14:26:21.366 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:21.367 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:21.391 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.394 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9a4e2af6, L:/127.0.0.1:43188 - R:/127.20.103.67:35767] using TOKEN/null
14:26:21.394 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.402 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.407 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf1ff214c, L:/127.0.0.1:50876 - R:/127.20.103.66:35167] using TOKEN/null
14:26:21.409 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa5a541b1, L:/127.0.0.1:43192 - R:/127.20.103.67:35767] using TOKEN/null
14:26:21.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.425 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.425 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.437 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:21.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:21.437 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:21.437 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:26:21.442 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.442 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.450 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.450 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.458 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.458 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:21.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:21.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:21.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:21.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:21.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:21.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:21.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:21.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:21.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:21.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:21.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:21.483 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:21.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.537 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.537 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.545 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.546 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.555 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.556 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.584 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.591 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.591 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.592 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:21.592 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:21.592 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:21.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:21.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:21.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:21.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:21.593 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:21.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:21.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:21.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:21.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:21.593 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:21.653 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.653 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.657 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:21.657 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:21.657 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:21.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:21.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:21.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:21.660 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.660 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.663 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:21.663 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:21.663 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:21.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:21.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:21.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:21.664 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:21.666 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.666 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.669 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e295afb429588265e88d1d4eceb64e9fadee1b7c51235fb44df4c720515d462d]
14:26:21.670 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:26:21.670 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:26:21.674 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:21.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.675 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e295afb429588265e88d1d4eceb64e9fadee1b7c51235fb44df4c720515d462d finished by subtask 1; deferring removal (restored in pending)
14:26:21.675 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:21.685 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.686 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.690 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.690 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.700 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:21.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:21.700 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:26:21.700 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:26:21.725 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 4459c5bc8e668403214dd967e9f85899 (5026 bytes, checkpointDuration=567 ms, finalizationTime=0 ms).
14:26:21.728 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:26:21.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 7a4a463341324c4d4a011644d09c67e70d6a4d04417ab7309b36b35f5959dc80 from pending
14:26:21.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 8bb3ee0259bcb44ab98342d8da200c0173391c3922e94053743f9e4071ef89e1 from pending
14:26:21.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split c3d05ca7e13634a5d1ac402f8ed9ae74b35057b62a2078ce25732eea185be739 from pending
14:26:21.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split de9710b85afd2503e4c09583b96404e75d05e714c8ba23b05828917dd702b3fb from pending
14:26:21.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split c494d75fb52f44c94e023be6a1c68519f4f1ebabe63568b6fbb1e2d68e4dc23c from pending
14:26:21.729 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split e295afb429588265e88d1d4eceb64e9fadee1b7c51235fb44df4c720515d462d from pending
14:26:21.729 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 6 finished splits from enumerator state
14:26:21.734 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.734 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.737 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114381727 for job 4459c5bc8e668403214dd967e9f85899.
14:26:21.740 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@82e522c, flushNotification=Deferred@1492321406(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:26:21.741 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] connecting to peer
14:26:21.741 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=126, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6b001382, flushNotification=Deferred@1291313600(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:26:21.741 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] connecting to peer
14:26:21.775 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] Successfully connected to peer
14:26:21.791 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] Successfully connected to peer
14:26:21.796 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.796 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.809 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.809 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.820 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:21.820 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:21.820 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:21.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:21.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:21.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:21.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:21.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:21.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:21.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:21.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:21.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:21.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:21.848 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.848 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.855 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.855 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.856 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:21.861 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.861 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:21.873 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:21.875 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe32df644, L:/127.0.0.1:50890 - R:/127.20.103.66:35167] using TOKEN/null
14:26:21.878 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x62ab33c1, L:/127.0.0.1:56228 - R:/127.20.103.65:40757] using TOKEN/null
14:26:21.924 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.925 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:21.931 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.931 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:21.939 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.939 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:21.948 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.948 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:21.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:21.957962 22195 log.cc:927] Time spent T eb57a75ce4fc4f34a064173a55fc60fa P 53d7c903ee4c473aa5f0b637189c6e7d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
14:26:21.958 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:21.958 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:21.991 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=264 ms, finalizationTime=0 ms).
14:26:21.993 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:26:22.009 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.009 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.069 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.069 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:22.076 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.076 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:22.084 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.084 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:22.098 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.098 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:22.111 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.111 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:22.129 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.129 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.134 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:22.134 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:22.135 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:22.135 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:22.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.135 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.135 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.135 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.135 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.135 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.135 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.135 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:22.140 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:22.144 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:22.147 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:22.157 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:22.157 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:22.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114382158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:22.170 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:26:22.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:22.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:22.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.173 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:22.178 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:22.185 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 511b5d833e2540fc82b2af60f12d2689
14:26:22.191 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:22.191 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:22.191 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:22.192 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:22.192 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:22.192 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:22.192 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:22.192 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.19.148.60:37365, [6ms] Sub RPC GetTableLocations: received response from server master-127.19.148.60:37365: OK, deferred=null)) after lookup
14:26:22.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 394fedcdf5784f7f8b123aa3e85deaaa for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:22.243 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.243 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet ad4d7093598a433b8ed42c0520e061c7 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:22.247 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:22.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:22.251 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:22.254 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='40906bed732311288fd8a634d5c2b7f466475990579a24a39559d3f477fce3ef'}]
14:26:22.256 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='185ede7a95b81dcf2b445e6424bedce692512e1ed02fcdf6cf0d8e462f06f6e4'}]
14:26:22.257 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.257 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:26:22.257 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ca5df4e2627d5684a1c00b6513d06882eb70ec6a7fff01f5f4583f6942728630'}]
14:26:22.258 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:22.258 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.259 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='618fec1bab9c638f42c3f16ab7fa9ccbc430a6ba1dfeff65dbb0b2f9f75b768b'}]
14:26:22.260 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.260 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
14:26:22.261 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:22.261 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:26:22.262 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:22.262 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:26:22.262 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:22.263 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.269 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.269 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.269 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4652257de6734e049df6608b64d5e2b1 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:22.274 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RESTARTING to RUNNING.
14:26:22.274 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 2c28d6d49adcc0d598680955c9f9304b from Checkpoint 69 @ 1779114320041 for 2c28d6d49adcc0d598680955c9f9304b located at file:/tmp/junit9781152734840635638/checkpoints/2c28d6d49adcc0d598680955c9f9304b/chk-69.
14:26:22.275 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:26:22.275 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
14:26:22.275 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.276 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
14:26:22.276 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 8e9538df5a0dfbedb16829666ce7ddc2
14:26:22.276 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:22.277 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 69 for source Source: KuduSource to checkpoint.
14:26:22.278 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:26:22.279 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 8e9538df5a0dfbedb16829666ce7ddc2.
14:26:22.280 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.285 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.293 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.298 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.303 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
14:26:22.303 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
14:26:22.304 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1844d6e8
14:26:22.304 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:22.304 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:26:22.304 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:26:22.304 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:26:22.308 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.312 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.331 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@196e1936
14:26:22.337 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.338 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.343 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.343 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.347 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.347 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e3a4162415154ed8ba26ea64fa8f8161 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:22.347 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.350 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaf45130f, L:/127.0.0.1:39756 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.354 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.357 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.363 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.363 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 4d5dd44151694c89a880404d0f161d64 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:22.368 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.368 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.369 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [185ede7a95b81dcf2b445e6424bedce692512e1ed02fcdf6cf0d8e462f06f6e4]
14:26:22.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [185ede7a95b81dcf2b445e6424bedce692512e1ed02fcdf6cf0d8e462f06f6e4]
14:26:22.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:26:22.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:26:22.371 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 185ede7a95b81dcf2b445e6424bedce692512e1ed02fcdf6cf0d8e462f06f6e4 finished by subtask 2; deferring removal (restored in pending)
14:26:22.372 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.373 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cc30a0c021c19c9a5d16881a79f71daecc54b4a6b1a8624d9f3bc141b9a6be10'}]
14:26:22.374 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.375 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.387 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:26:22.392 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.393 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299994, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:22.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ed72fc8fc2a449d0b2c8519ac4872540 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.404 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a48d550c478645c4a86bb681c15c1b56 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ea76dbfe58b54be491e3904c3b089ecb for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7b84f2b00f7d4bd483a216521cbc693a for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 050aee52c0944bd8b2f5766c38016439 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet eb57a75ce4fc4f34a064173a55fc60fa for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 64c4faa671754965bbf21cbab502f65f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:22.405 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=a48d550c478645c4a86bb681c15c1b56@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ea76dbfe58b54be491e3904c3b089ecb@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=7b84f2b00f7d4bd483a216521cbc693a@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)[L],53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=050aee52c0944bd8b2f5766c38016439@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=eb57a75ce4fc4f34a064173a55fc60fa@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)[L],8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=64c4faa671754965bbf21cbab502f65f@[50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767),53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757),8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:22.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.20.103.125:34309, [5ms] Sub RPC GetTableLocations: received response from server master-127.20.103.125:34309: OK, deferred=null)) after lookup
14:26:22.406 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9e01b0da, L:/127.0.0.1:39780 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.406 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf7dffa70, L:/127.0.0.1:39770 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.417 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:22.435 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.435 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:22.452 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.452 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [40906bed732311288fd8a634d5c2b7f466475990579a24a39559d3f477fce3ef]
14:26:22.453 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [40906bed732311288fd8a634d5c2b7f466475990579a24a39559d3f477fce3ef]
14:26:22.453 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
14:26:22.453 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
14:26:22.454 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 40906bed732311288fd8a634d5c2b7f466475990579a24a39559d3f477fce3ef finished by subtask 0; deferring removal (restored in pending)
14:26:22.454 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.455 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:22.455 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.456 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8c2a0b9459f2cf0cdcdc42569418d3e39fbb8d8be173575dea6db697f1f1f130'}]
14:26:22.457 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:22.462 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.464 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.464 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:22.472 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.472 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:22.473 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:22.473 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:22.473 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:22.473 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:22.473 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:22.473 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:22.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:22.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:22.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:22.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:22.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:22.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:22.474 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:22.489 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.489 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.505 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:22.505 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:22.505 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:22.505 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.505 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.505 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.506 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.506 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.506 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.506 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:22.506 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4dbc875b, L:/127.0.0.1:39796 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.514 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.520 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.520 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.522 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.522 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [618fec1bab9c638f42c3f16ab7fa9ccbc430a6ba1dfeff65dbb0b2f9f75b768b]
14:26:22.522 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [618fec1bab9c638f42c3f16ab7fa9ccbc430a6ba1dfeff65dbb0b2f9f75b768b]
14:26:22.523 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:26:22.523 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:26:22.523 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 618fec1bab9c638f42c3f16ab7fa9ccbc430a6ba1dfeff65dbb0b2f9f75b768b finished by subtask 1; deferring removal (restored in pending)
14:26:22.524 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.525 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.525 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.555 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.555 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.555 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:26:22.560 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.560 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 394fedcdf5784f7f8b123aa3e85deaaa for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:22.565 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.566 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ca5df4e2627d5684a1c00b6513d06882eb70ec6a7fff01f5f4583f6942728630]
14:26:22.566 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ca5df4e2627d5684a1c00b6513d06882eb70ec6a7fff01f5f4583f6942728630]
14:26:22.566 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:26:22.566 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:26:22.567 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ca5df4e2627d5684a1c00b6513d06882eb70ec6a7fff01f5f4583f6942728630 finished by subtask 3; deferring removal (restored in pending)
14:26:22.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet ad4d7093598a433b8ed42c0520e061c7 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:22.569 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.569 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.596 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4652257de6734e049df6608b64d5e2b1 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:22.621 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.621 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e3a4162415154ed8ba26ea64fa8f8161 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:22.626 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.626 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.626 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:26:22.632 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.632 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 4d5dd44151694c89a880404d0f161d64 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:22.652 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.652 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ed72fc8fc2a449d0b2c8519ac4872540 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114382658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:22.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.679 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.680 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.681 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:26:22.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:22.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:22.686 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:22.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.687 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.687 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.687 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:22.703 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
14:26:22.704 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299998, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:22.707 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 4459c5bc8e668403214dd967e9f85899 (5086 bytes, checkpointDuration=49 ms, finalizationTime=0 ms).
14:26:22.709 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:26:22.709 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 40906bed732311288fd8a634d5c2b7f466475990579a24a39559d3f477fce3ef from pending
14:26:22.709 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split ca5df4e2627d5684a1c00b6513d06882eb70ec6a7fff01f5f4583f6942728630 from pending
14:26:22.709 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 618fec1bab9c638f42c3f16ab7fa9ccbc430a6ba1dfeff65dbb0b2f9f75b768b from pending
14:26:22.709 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 185ede7a95b81dcf2b445e6424bedce692512e1ed02fcdf6cf0d8e462f06f6e4 from pending
14:26:22.709 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 4 finished splits from enumerator state
14:26:22.725 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.725 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.725 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
14:26:22.728 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:22.732 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a48d550c478645c4a86bb681c15c1b56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.733 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a48d550c478645c4a86bb681c15c1b56 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
14:26:22.740 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ea76dbfe58b54be491e3904c3b089ecb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.740 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ea76dbfe58b54be491e3904c3b089ecb for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
14:26:22.747 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.754 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:22.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:22.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:22.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:22.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:22.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:22.758 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:22.758 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:22.758 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:22.758 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:22.758 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:22.758 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:22.758 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:22.760 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:22.760 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:22.760 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:22.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:22.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:22.760 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:22.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:22.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:22.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:22.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:22.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:22.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:22.761 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:22.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.773 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.785 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:22.789 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.793 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:22.798 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7b84f2b00f7d4bd483a216521cbc693a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.799 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7b84f2b00f7d4bd483a216521cbc693a for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
14:26:22.801 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.802 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.802 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.811 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.816 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=050aee52c0944bd8b2f5766c38016439, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.817 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 050aee52c0944bd8b2f5766c38016439 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
14:26:22.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.823 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.828 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:22.829 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.832 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb57a75ce4fc4f34a064173a55fc60fa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.832 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet eb57a75ce4fc4f34a064173a55fc60fa for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
14:26:22.836 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9a7805d9, L:/127.0.0.1:39800 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.842 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.843 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.843 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.843 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.844 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.845 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [8c2a0b9459f2cf0cdcdc42569418d3e39fbb8d8be173575dea6db697f1f1f130]
14:26:22.845 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8c2a0b9459f2cf0cdcdc42569418d3e39fbb8d8be173575dea6db697f1f1f130]
14:26:22.845 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:26:22.845 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:26:22.846 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8c2a0b9459f2cf0cdcdc42569418d3e39fbb8d8be173575dea6db697f1f1f130 finished by subtask 0; deferring removal (restored in pending)
14:26:22.846 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.847 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.852 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.853 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.853 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.853 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9d1b22ba, L:/127.0.0.1:39798 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:22.857 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:22.868 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.868 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.868 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.869 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.870 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:22.870 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:22.870 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:22.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:22.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:22.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:22.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:22.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:22.871 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:22.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:22.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:22.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:22.871 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:22.882 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=64c4faa671754965bbf21cbab502f65f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.882 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 64c4faa671754965bbf21cbab502f65f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] disconnecting while in state READY
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] disconnecting while in state READY
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state READY
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state READY
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state READY
14:26:22.882 [DEBUG - main] (Connection.java:575) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] disconnecting while in state READY
14:26:22.883 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:22.883 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] handling channelInactive
14:26:22.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:22.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] cleaning up while in state READY due to: connection closed
14:26:22.883 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:22.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:22.884 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:22.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:22.884 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] handling channelInactive
14:26:22.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] cleaning up while in state READY due to: connection closed
14:26:22.886 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.886 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:22.886 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:22.886 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
14:26:22.887 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.887 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
14:26:22.888 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:22.888 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:22.888 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:22.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.888 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:22.889 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.889 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:22.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:22.889 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:22.889 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.889 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.889 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.890 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.890 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.890 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.890 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.890 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.890 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.890 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.890 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.890 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.890 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.898 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252509671424001) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:22.899 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [cc30a0c021c19c9a5d16881a79f71daecc54b4a6b1a8624d9f3bc141b9a6be10]
14:26:22.899 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cc30a0c021c19c9a5d16881a79f71daecc54b4a6b1a8624d9f3bc141b9a6be10]
14:26:22.899 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
14:26:22.899 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
14:26:22.899 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:22.900 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cc30a0c021c19c9a5d16881a79f71daecc54b4a6b1a8624d9f3bc141b9a6be10 finished by subtask 2; deferring removal (restored in pending)
14:26:22.901 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:22.909 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.909 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.909 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.910 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.910 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.910 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.910 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.919 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] handling channelInactive
14:26:22.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] cleaning up while in state READY due to: connection closed
14:26:22.919 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-5
14:26:22.922 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:26:22.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:22.920315 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 21185
14:26:22.923 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.923 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.923 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.924 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:22.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:22.924 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:22.924 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
14:26:22.925 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:22.925 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:22.925 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:22.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:22.926 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.926 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.926 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:22.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:22.926 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:22.948 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.948 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.949 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.950 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.950 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.950 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.950 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:22.988 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:22.988 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:22.988 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:22.989 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.989 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.989 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:22.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:22.990 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.990 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.990 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:22.990 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:23.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.085 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:23.085 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:23.085 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:23.086 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.086 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.086 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.086 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.086 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.086 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:23.148 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] handling channelInactive
14:26:23.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] cleaning up while in state READY due to: connection closed
14:26:23.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:23.152530 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 21425
14:26:23.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.151031 21641 connection.cc:582] client connection to 127.20.103.65:40757 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:23.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.157861 21641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:23.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114383159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:23.168 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:23.169 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:23.169 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:23.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.170 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.170 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.170 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.170 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.170 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.170 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.170 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:23.171 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 4459c5bc8e668403214dd967e9f85899 (2338 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:26:23.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:26:23.173 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split cc30a0c021c19c9a5d16881a79f71daecc54b4a6b1a8624d9f3bc141b9a6be10 from pending
14:26:23.173 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split 8c2a0b9459f2cf0cdcdc42569418d3e39fbb8d8be173575dea6db697f1f1f130 from pending
14:26:23.173 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 6 complete: removed 2 finished splits from enumerator state
14:26:23.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.228521 21641 consensus_peers.cc:597] T a48d550c478645c4a86bb681c15c1b56 P 50f3e1b9790e4e1381b0fb94571564d6 -> Peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Couldn't send request to peer 53d7c903ee4c473aa5f0b637189c6e7d. Status: Network error: Client connection negotiation failed: client connection to 127.20.103.65:40757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:26:23.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.255431 21641 consensus_peers.cc:597] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 -> Peer 53d7c903ee4c473aa5f0b637189c6e7d (127.20.103.65:40757): Couldn't send request to peer 53d7c903ee4c473aa5f0b637189c6e7d. Status: Network error: Client connection negotiation failed: client connection to 127.20.103.65:40757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:26:23.273 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] handling channelInactive
14:26:23.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] cleaning up while in state READY due to: connection closed
14:26:23.273 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] handling channelInactive
14:26:23.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] cleaning up while in state READY due to: connection closed
14:26:23.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.273317 21640 connection.cc:582] client connection to 127.20.103.66:35167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.280192 22267 negotiation.cc:336] Failed RPC negotiation. Trace:
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:23.275490 (+     0us) reactor.cc:678] Submitting negotiation task for client connection to 127.20.103.66:35167 (local address 127.20.103.67:56203)
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:23.276416 (+   926us) negotiation.cc:107] Waiting for socket to connect
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:23.276468 (+    52us) client_negotiation.cc:175] Beginning negotiation
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:23.276873 (+   405us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:23.278899 (+  2026us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.103.66:35167: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:23.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":387}
14:26:23.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:23.281030 21640 consensus_peers.cc:597] T 7b84f2b00f7d4bd483a216521cbc693a P 50f3e1b9790e4e1381b0fb94571564d6 -> Peer 8e2070f9879f4b97aca892de05842e15 (127.20.103.66:35167): Couldn't send request to peer 8e2070f9879f4b97aca892de05842e15. Status: Network error: Client connection negotiation failed: client connection to 127.20.103.66:35167: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
14:26:23.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:23.291592 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 21621
14:26:23.349 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] handling channelInactive
14:26:23.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] cleaning up while in state READY due to: connection closed
14:26:23.351 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] handling channelInactive
14:26:23.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] cleaning up while in state READY due to: connection closed
14:26:23.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:23.355895 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20905
14:26:23.357 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:23.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:23.366 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:23.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.368 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:23.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:23.432 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.103.126:39327(127.20.103.126:39327)] handling channelInactive
14:26:23.432 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state READY due to: connection closed
14:26:23.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:23.444422 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20976
14:26:23.499 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:23.499 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:23.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.505 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:23.505 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:23.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:23.506 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.103.125:34309(127.20.103.125:34309)] handling channelInactive
14:26:23.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:23.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:23.512172 20893 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 21051
14:26:23.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state READY due to: connection closed
14:26:23.525 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:23.525 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:23.525 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:23.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:23.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:23.527 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.527 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.527 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:23.527 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:23.549 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:23.549 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:23.549 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:23.550 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.550 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.550 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.550 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.550 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.551 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:23.559 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:23.559 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:23.559 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:23.559 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.560 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.560 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.560 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.560 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:23.583 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:23.583 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:23.585 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:23.585 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:23.592 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:23.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:23.598 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.103.124:41795(127.20.103.124:41795)] handling channelInactive
14:26:23.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state READY due to: connection closed
14:26:23.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114383658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:23.671 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:26:23.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:26:23.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:23.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:23.751 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:23.751 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.751 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.751 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:23.752 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.752 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.752 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:23.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:23.752 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:23.788 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:23.789 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:23.789 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:23.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:23.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.790 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.790 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:23.790 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:23.790 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:23.826 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:23.827 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:23.827 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:23.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:23.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:23.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:23.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:23.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:23.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:23.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:23.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:23.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:23.828 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:23.856 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:23.974 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:23.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:23.975 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:23.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:23.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:23.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:23.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:23.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:23.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:23.976 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:23.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:23.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:23.976 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:24.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114384158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:24.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:26:24.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:26:24.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.249 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:24.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:24.256 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:24.261 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9f049704b765bfbba3324be7ec00cd91265c4688a6d317f4aa978d63fb72ef17'}]
14:26:24.263 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.263 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='aa8d40c04267f11bff7bb444763bcc9c73be66dc51152a1b33c8545dc47c7d36'}]
14:26:24.264 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.265 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='dbeb625535ed22a2611608fb296c34d797b77c3f537d2edd3a231bc8b54c7d2b'}]
14:26:24.266 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.266 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='77d877650f6ecf788f412eda06ec5e609b586becd2b2e01c438ba771cd7618de'}]
14:26:24.266 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:24.266 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:24.266 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:24.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.267 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.267 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:26:24.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.267 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:24.267 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:24.268 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:26:24.268 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:24.269 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:26:24.269 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:24.269 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
14:26:24.270 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:24.272 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.282 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.287 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.296 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.312 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.322 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.323 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.328 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.348 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.348 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.350 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.353 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.413 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:24.413 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:24.413 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:24.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:24.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:24.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:24.419 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:24.419 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:24.419 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:24.419 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:24.419 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:24.419 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:24.419 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:24.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.430 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.431 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.430 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.434 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4efab81, L:/127.0.0.1:39802 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.442 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:24.442 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:24.443 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:24.443 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.443 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.443 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.443 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.443 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.443 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:24.448 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaa5ce42a, L:/127.0.0.1:39848 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.452 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.470 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x72684c58, L:/127.0.0.1:39818 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.478 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.479 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [9f049704b765bfbba3324be7ec00cd91265c4688a6d317f4aa978d63fb72ef17]
14:26:24.479 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9f049704b765bfbba3324be7ec00cd91265c4688a6d317f4aa978d63fb72ef17]
14:26:24.479 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:26:24.479 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:26:24.480 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:24.480 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:24.480 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:24.480 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9f049704b765bfbba3324be7ec00cd91265c4688a6d317f4aa978d63fb72ef17 finished by subtask 1; deferring removal (restored in pending)
14:26:24.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.481 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.481 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.481 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.481 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:24.482 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.482 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a6dd0f3a805150ae1366dc2dd9ff9dc6baa0cd6c2d51c1ffdfc537162dfad648'}]
14:26:24.482 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.483 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.483 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:26:24.484 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:24.489 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.505 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.506 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:26:24.506 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3b7b103a, L:/127.0.0.1:39832 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.506 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.507 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.515 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.528 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.528 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [aa8d40c04267f11bff7bb444763bcc9c73be66dc51152a1b33c8545dc47c7d36]
14:26:24.528 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [aa8d40c04267f11bff7bb444763bcc9c73be66dc51152a1b33c8545dc47c7d36]
14:26:24.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:26:24.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:26:24.529 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.529 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.529 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split aa8d40c04267f11bff7bb444763bcc9c73be66dc51152a1b33c8545dc47c7d36 finished by subtask 3; deferring removal (restored in pending)
14:26:24.532 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1551149b4a73f240ef63304781f22d89bf2b0f5987c28cd0a7529139a1b04849'}]
14:26:24.534 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:24.534 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:26:24.535 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:24.546 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.546 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.546 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.547 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:26:24.549 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.549 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [dbeb625535ed22a2611608fb296c34d797b77c3f537d2edd3a231bc8b54c7d2b]
14:26:24.550 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [dbeb625535ed22a2611608fb296c34d797b77c3f537d2edd3a231bc8b54c7d2b]
14:26:24.550 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:26:24.550 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:26:24.550 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split dbeb625535ed22a2611608fb296c34d797b77c3f537d2edd3a231bc8b54c7d2b finished by subtask 0; deferring removal (restored in pending)
14:26:24.551 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.551 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.557 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:24.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:24.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:24.564 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:24.564 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.565 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.565 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.565 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.565 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.565 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.565 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.565 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.565 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:24.566 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28091), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [98ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [150ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [262ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] refreshing cache from master, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [365ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [367ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [369ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [376ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [376ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [461ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [462ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [642ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [642ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2122ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5180ms] refreshing cache from master, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5181ms] too many traces: truncated at 100 traces, deferred=Deferred@2025830808(state=PENDING, result=null, callback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655), errback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655)))
14:26:24.566 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.567 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.567 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:26:24.567 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28091), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [98ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [150ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [262ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] refreshing cache from master, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [365ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [367ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [369ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [376ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [376ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [461ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [462ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [642ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [642ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2122ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5180ms] refreshing cache from master, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5181ms] too many traces: truncated at 100 traces, deferred=Deferred@2025830808(state=PENDING, result=null, callback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655), errback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:24.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
14:26:24.567 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:26:24.571 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
14:26:24.568 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:24.574 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28091), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [50ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [56ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [98ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [150ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [223ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [223ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [262ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [364ms] refreshing cache from master, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [365ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [367ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [369ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [376ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [376ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [461ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [462ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [462ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [641ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [642ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [642ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [721ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [722ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2122ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5180ms] refreshing cache from master, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [5181ms] too many traces: truncated at 100 traces, deferred=Deferred@2025830808(state=PENDING, result=null, callback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655), errback=(continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107) -> (continuation of Deferred@795571824 after retry RPC after error@981264655)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:24.575 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:24.577 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
14:26:24.577 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
14:26:24.577 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:26:24.582 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:24.590 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.591 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:24.591 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:24.591 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:24.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:24.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.592 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.592 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:24.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:24.592 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:24.593 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2d1c31a1, L:/127.0.0.1:39870 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.605 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:24.609 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe966ed5d, L:/127.0.0.1:39858 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:24.627 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.627 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [a6dd0f3a805150ae1366dc2dd9ff9dc6baa0cd6c2d51c1ffdfc537162dfad648]
14:26:24.627 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a6dd0f3a805150ae1366dc2dd9ff9dc6baa0cd6c2d51c1ffdfc537162dfad648]
14:26:24.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:26:24.628 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:26:24.629 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a6dd0f3a805150ae1366dc2dd9ff9dc6baa0cd6c2d51c1ffdfc537162dfad648 finished by subtask 1; deferring removal (restored in pending)
14:26:24.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.630 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114384658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:24.666 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.666 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [1551149b4a73f240ef63304781f22d89bf2b0f5987c28cd0a7529139a1b04849]
14:26:24.666 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1551149b4a73f240ef63304781f22d89bf2b0f5987c28cd0a7529139a1b04849]
14:26:24.667 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:26:24.667 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:26:24.667 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1551149b4a73f240ef63304781f22d89bf2b0f5987c28cd0a7529139a1b04849 finished by subtask 3; deferring removal (restored in pending)
14:26:24.667 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.668 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.669 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 4459c5bc8e668403214dd967e9f85899 (5086 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:24.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:26:24.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split a6dd0f3a805150ae1366dc2dd9ff9dc6baa0cd6c2d51c1ffdfc537162dfad648 from pending
14:26:24.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 1551149b4a73f240ef63304781f22d89bf2b0f5987c28cd0a7529139a1b04849 from pending
14:26:24.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split dbeb625535ed22a2611608fb296c34d797b77c3f537d2edd3a231bc8b54c7d2b from pending
14:26:24.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 9f049704b765bfbba3324be7ec00cd91265c4688a6d317f4aa978d63fb72ef17 from pending
14:26:24.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split aa8d40c04267f11bff7bb444763bcc9c73be66dc51152a1b33c8545dc47c7d36 from pending
14:26:24.673 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 5 finished splits from enumerator state
14:26:24.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:24.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:24.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:24.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:24.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.675 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:24.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.675 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.675 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:24.675 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:24.675 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.685 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.686 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.686 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:26:24.689 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:26:24.689 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.689 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.770 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252517863424001) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:24.770 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [77d877650f6ecf788f412eda06ec5e609b586becd2b2e01c438ba771cd7618de]
14:26:24.771 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [77d877650f6ecf788f412eda06ec5e609b586becd2b2e01c438ba771cd7618de]
14:26:24.771 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
14:26:24.771 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
14:26:24.772 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 77d877650f6ecf788f412eda06ec5e609b586becd2b2e01c438ba771cd7618de finished by subtask 2; deferring removal (restored in pending)
14:26:24.773 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:24.773 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:24.803 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:24.803 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:24.804 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
14:26:24.806 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:24.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.809 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.810 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28315), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [192ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [192ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [209ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [347ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [361ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [661ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [662ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2282ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@1309725593(state=PENDING, result=null, callback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875), errback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875)))
14:26:24.811 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.811 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.811 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.812 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28315), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [192ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [192ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [209ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [347ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [361ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [661ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [662ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2282ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@1309725593(state=PENDING, result=null, callback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875), errback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28315), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [192ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [192ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [209ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [347ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [361ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [661ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [662ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2282ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@1309725593(state=PENDING, result=null, callback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875), errback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.190:41547
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:24.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.813 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.813 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.817 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28315), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [192ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [192ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [209ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [347ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [361ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [661ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [662ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2282ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@1309725593(state=PENDING, result=null, callback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875), errback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28315), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [192ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [192ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [209ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [347ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [347ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [361ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [661ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [662ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [2282ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@1309725593(state=PENDING, result=null, callback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875), errback=(continuation of Deferred@1376537677 after retry RPC after error@641608967) -> (continuation of Deferred@562299591 after retry RPC after error@1765839221) -> (continuation of Deferred@1503581748 after retry RPC after error@236949013) -> (continuation of Deferred@260843307 after retry RPC after error@1646974102) -> (continuation of Deferred@1294631313 after retry RPC after error@1069007111) -> (continuation of Deferred@1366039717 after retry RPC after error@1708584058) -> (continuation of Deferred@2095701848 after retry RPC after error@2102887995) -> (continuation of Deferred@1282352128 after retry RPC after error@512271563) -> (continuation of Deferred@740928349 after retry RPC after error@1829668541) -> (continuation of Deferred@1484058680 after retry RPC after error@58833153) -> (continuation of Deferred@1645451631 after retry RPC after error@2075246846) -> (continuation of Deferred@70982272 after retry RPC after error@184349367) -> (continuation of Deferred@1960495718 after retry RPC after error@18436659) -> (continuation of Deferred@1571469194 after retry RPC after error@808357826) -> (continuation of Deferred@310770267 after retry RPC after error@1497807602) -> (continuation of Deferred@1373126839 after retry RPC after error@365729233) -> (continuation of Deferred@682029585 after retry RPC after error@1146838237) -> (continuation of Deferred@1469407513 after retry RPC after error@637928487) -> (continuation of Deferred@967789708 after retry RPC after error@655119056) -> (continuation of Deferred@1542288001 after retry RPC after error@1306292967) -> (continuation of Deferred@248810748 after retry RPC after error@1267451172) -> (continuation of Deferred@2067980206 after retry RPC after error@1428672875)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.190:41547
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:24.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.820 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.820 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:24.821 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
14:26:24.821 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
14:26:24.822 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:26:24.822 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
14:26:24.822 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:26:24.822 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
14:26:24.822 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
14:26:24.823 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
14:26:24.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
14:26:24.827 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.827 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.827 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.830 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.830 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.838 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:26:24.838 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
14:26:24.838 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:26:24.846 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.846 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.846 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.847 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.847 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:24.867 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.867 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.867 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.868 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.868 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.868 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.868 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.868 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.868 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.868 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.870 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
14:26:24.870 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
14:26:24.870 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
14:26:24.873 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:26:24.873 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
14:26:24.873 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
14:26:24.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.886 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.887 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.888 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
14:26:24.889 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
14:26:24.889 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
14:26:24.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:26:24.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
14:26:24.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
14:26:24.914 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
14:26:24.914 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
14:26:24.914 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
14:26:24.917 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
14:26:24.918 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
14:26:24.918 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
14:26:24.919 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:24.919 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:24.919 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:26:24.927 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.927 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.927 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.928 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.928 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.928 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.928 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.928 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.966 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:24.967 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:24.967 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:24.967 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.967 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:24.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:24.968 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.968 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.968 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:24.968 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:24.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:24.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:24.971 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:24.971 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.971 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:24.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:24.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.972 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:24.972 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:24.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28433), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [32ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [33ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [34ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [160ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [199ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [228ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [228ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [299ms] refreshing cache from master, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [304ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [305ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [305ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [305ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [322ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [521ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [522ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [522ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [522ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [564ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [564ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1082ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1682ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3600ms] refreshing cache from master, [3600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [3601ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [6180ms] refreshing cache from master, [6180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1927714301(state=PENDING, result=null, callback=(continuation of Deferred@1015096910 after retry RPC after error@565795080) -> (continuation of Deferred@1036789449 after retry RPC after error@2067990000) -> (continuation of Deferred@1321594752 after retry RPC after error@635407945) -> (continuation of Deferred@2046369365 after retry RPC after error@452388895) -> (continuation of Deferred@2066656558 after retry RPC after error@576379332) -> (continuation of Deferred@325083244 after retry RPC after error@1056687119) -> (continuation of Deferred@808605987 after retry RPC after error@1146233368) -> (continuation of Deferred@1411467774 after retry RPC after error@874128585) -> (continuation of Deferred@381913128 after retry RPC after error@1129593354) -> (continuation of Deferred@493151527 after retry RPC after error@2017310254) -> (continuation of Deferred@1916138441 after retry RPC after error@273875951) -> (continuation of Deferred@707039519 after retry RPC after error@1061019315) -> (continuation of Deferred@1657526566 after retry RPC after error@1779430123) -> (continuation of Deferred@1689074396 after retry RPC after error@892647612) -> (continuation of Deferred@160060885 after retry RPC after error@470251173) -> (continuation of Deferred@292668451 after retry RPC after error@17858537) -> (continuation of Deferred@1525655267 after retry RPC after error@2113556805) -> (continuation of Deferred@1656082949 after retry RPC after error@1624770189) -> (continuation of Deferred@1202158795 after retry RPC after error@1752726787) -> (continuation of Deferred@613531635 after retry RPC after error@73218434) -> (continuation of Deferred@2019581158 after retry RPC after error@1406903948) -> (continuation of Deferred@2048714019 after retry RPC after error@392184523) -> (continuation of Deferred@1839049645 after retry RPC after error@1677496148) -> (continuation of Deferred@2127846389 after retry RPC after error@1807165694), errback=(continuation of Deferred@1015096910 after retry RPC after error@565795080) -> (continuation of Deferred@1036789449 after retry RPC after error@2067990000) -> (continuation of Deferred@1321594752 after retry RPC after error@635407945) -> (continuation of Deferred@2046369365 after retry RPC after error@452388895) -> (continuation of Deferred@2066656558 after retry RPC after error@576379332) -> (continuation of Deferred@325083244 after retry RPC after error@1056687119) -> (continuation of Deferred@808605987 after retry RPC after error@1146233368) -> (continuation of Deferred@1411467774 after retry RPC after error@874128585) -> (continuation of Deferred@381913128 after retry RPC after error@1129593354) -> (continuation of Deferred@493151527 after retry RPC after error@2017310254) -> (continuation of Deferred@1916138441 after retry RPC after error@273875951) -> (continuation of Deferred@707039519 after retry RPC after error@1061019315) -> (continuation of Deferred@1657526566 after retry RPC after error@1779430123) -> (continuation of Deferred@1689074396 after retry RPC after error@892647612) -> (continuation of Deferred@160060885 after retry RPC after error@470251173) -> (continuation of Deferred@292668451 after retry RPC after error@17858537) -> (continuation of Deferred@1525655267 after retry RPC after error@2113556805) -> (continuation of Deferred@1656082949 after retry RPC after error@1624770189) -> (continuation of Deferred@1202158795 after retry RPC after error@1752726787) -> (continuation of Deferred@613531635 after retry RPC after error@73218434) -> (continuation of Deferred@2019581158 after retry RPC after error@1406903948) -> (continuation of Deferred@2048714019 after retry RPC after error@392184523) -> (continuation of Deferred@1839049645 after retry RPC after error@1677496148) -> (continuation of Deferred@2127846389 after retry RPC after error@1807165694)))
14:26:25.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.006 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:25.006 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:25.006 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:25.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.007 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.007 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.007 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.007 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.007 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:25.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:25.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:25.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:25.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.048 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.048 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.048 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:25.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114385158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:25.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.174 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 4459c5bc8e668403214dd967e9f85899 (1651 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:26:25.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:26:25.178 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 10 complete: removed split 77d877650f6ecf788f412eda06ec5e609b586becd2b2e01c438ba771cd7618de from pending
14:26:25.178 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 10 complete: removed 1 finished splits from enumerator state
14:26:25.207 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:25.207 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:25.207 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:25.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.208 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.208 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.208 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.208 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.208 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.208 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.208 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.208 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:25.287 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:25.288 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:25.288 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:25.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:25.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:25.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:25.289 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:25.299 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:25.300 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:25.300 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:25.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.300 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.300 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:25.301 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28792), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [7ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [29ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [31ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [85ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [115ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [115ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [143ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [147ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [147ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [182ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [267ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [268ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [277ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [277ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [301ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [302ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [661ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1122ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1420ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1422ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1661ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1661ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2022ms] too many traces: truncated at 100 traces, deferred=Deferred@165606924(state=PENDING, result=null, callback=(continuation of Deferred@1671906733 after retry RPC after error@1970971580) -> (continuation of Deferred@1585962725 after retry RPC after error@546778543) -> (continuation of Deferred@2042924605 after retry RPC after error@1501804026) -> (continuation of Deferred@965945561 after retry RPC after error@552636433) -> (continuation of Deferred@2107131732 after retry RPC after error@963645816) -> (continuation of Deferred@428155759 after retry RPC after error@1028737110) -> (continuation of Deferred@46930511 after retry RPC after error@999170239) -> (continuation of Deferred@186704634 after retry RPC after error@1006897200) -> (continuation of Deferred@1593340829 after retry RPC after error@339295013) -> (continuation of Deferred@402795626 after retry RPC after error@73134802) -> (continuation of Deferred@421666143 after retry RPC after error@1151335757) -> (continuation of Deferred@1299708104 after retry RPC after error@383868630) -> (continuation of Deferred@530608560 after retry RPC after error@619610780) -> (continuation of Deferred@1454219121 after retry RPC after error@1252420764) -> (continuation of Deferred@1444395401 after retry RPC after error@104676277) -> (continuation of Deferred@1011972628 after retry RPC after error@1172976526) -> (continuation of Deferred@777654603 after retry RPC after error@1096116134) -> (continuation of Deferred@1986208834 after retry RPC after error@1644240707) -> (continuation of Deferred@472877569 after retry RPC after error@1982703221) -> (continuation of Deferred@419679686 after retry RPC after error@1938956962) -> (continuation of Deferred@319668563 after retry RPC after error@143184713) -> (continuation of Deferred@258101859 after retry RPC after error@1837622815), errback=(continuation of Deferred@1671906733 after retry RPC after error@1970971580) -> (continuation of Deferred@1585962725 after retry RPC after error@546778543) -> (continuation of Deferred@2042924605 after retry RPC after error@1501804026) -> (continuation of Deferred@965945561 after retry RPC after error@552636433) -> (continuation of Deferred@2107131732 after retry RPC after error@963645816) -> (continuation of Deferred@428155759 after retry RPC after error@1028737110) -> (continuation of Deferred@46930511 after retry RPC after error@999170239) -> (continuation of Deferred@186704634 after retry RPC after error@1006897200) -> (continuation of Deferred@1593340829 after retry RPC after error@339295013) -> (continuation of Deferred@402795626 after retry RPC after error@73134802) -> (continuation of Deferred@421666143 after retry RPC after error@1151335757) -> (continuation of Deferred@1299708104 after retry RPC after error@383868630) -> (continuation of Deferred@530608560 after retry RPC after error@619610780) -> (continuation of Deferred@1454219121 after retry RPC after error@1252420764) -> (continuation of Deferred@1444395401 after retry RPC after error@104676277) -> (continuation of Deferred@1011972628 after retry RPC after error@1172976526) -> (continuation of Deferred@777654603 after retry RPC after error@1096116134) -> (continuation of Deferred@1986208834 after retry RPC after error@1644240707) -> (continuation of Deferred@472877569 after retry RPC after error@1982703221) -> (continuation of Deferred@419679686 after retry RPC after error@1938956962) -> (continuation of Deferred@319668563 after retry RPC after error@143184713) -> (continuation of Deferred@258101859 after retry RPC after error@1837622815)))
14:26:25.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.428 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:25.428 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:25.429 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:25.429 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:25.429 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:25.429 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:25.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:25.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:25.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:25.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:25.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:25.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:25.430 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:25.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.620 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:25.621 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:25.621 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:25.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:25.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:25.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:25.621 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:25.622 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29124), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [45ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [45ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [104ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [107ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [107ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [204ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [205ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [261ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [339ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [339ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [381ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [382ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [382ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [382ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [503ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [503ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [780ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [781ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [781ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [782ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [782ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1383ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2881ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2882ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [3541ms] refreshing cache from master, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3541ms] too many traces: truncated at 100 traces, deferred=Deferred@694174745(state=PENDING, result=null, callback=(continuation of Deferred@995502234 after retry RPC after error@1963279367) -> (continuation of Deferred@1356405356 after retry RPC after error@2066926818) -> (continuation of Deferred@1898588646 after retry RPC after error@777027256) -> (continuation of Deferred@910297956 after retry RPC after error@1543144594) -> (continuation of Deferred@2076173074 after retry RPC after error@1454892899) -> (continuation of Deferred@1888018426 after retry RPC after error@2136546157) -> (continuation of Deferred@2080030951 after retry RPC after error@312458244) -> (continuation of Deferred@618583714 after retry RPC after error@334181159) -> (continuation of Deferred@1052456005 after retry RPC after error@1370210314) -> (continuation of Deferred@59930459 after retry RPC after error@1235885573) -> (continuation of Deferred@785646185 after retry RPC after error@569388073) -> (continuation of Deferred@835235811 after retry RPC after error@671860201) -> (continuation of Deferred@650272203 after retry RPC after error@116636766) -> (continuation of Deferred@1915796692 after retry RPC after error@81927158) -> (continuation of Deferred@813310628 after retry RPC after error@737180089) -> (continuation of Deferred@1557243407 after retry RPC after error@1215839176) -> (continuation of Deferred@704008033 after retry RPC after error@31704663) -> (continuation of Deferred@1356069306 after retry RPC after error@1501314579) -> (continuation of Deferred@1114304282 after retry RPC after error@1571047550) -> (continuation of Deferred@318075993 after retry RPC after error@708926642) -> (continuation of Deferred@1061582047 after retry RPC after error@1088302321) -> (continuation of Deferred@2033241871 after retry RPC after error@1505015895) -> (continuation of Deferred@1431883570 after retry RPC after error@1683015884) -> (continuation of Deferred@459750398 after retry RPC after error@1735216837), errback=(continuation of Deferred@995502234 after retry RPC after error@1963279367) -> (continuation of Deferred@1356405356 after retry RPC after error@2066926818) -> (continuation of Deferred@1898588646 after retry RPC after error@777027256) -> (continuation of Deferred@910297956 after retry RPC after error@1543144594) -> (continuation of Deferred@2076173074 after retry RPC after error@1454892899) -> (continuation of Deferred@1888018426 after retry RPC after error@2136546157) -> (continuation of Deferred@2080030951 after retry RPC after error@312458244) -> (continuation of Deferred@618583714 after retry RPC after error@334181159) -> (continuation of Deferred@1052456005 after retry RPC after error@1370210314) -> (continuation of Deferred@59930459 after retry RPC after error@1235885573) -> (continuation of Deferred@785646185 after retry RPC after error@569388073) -> (continuation of Deferred@835235811 after retry RPC after error@671860201) -> (continuation of Deferred@650272203 after retry RPC after error@116636766) -> (continuation of Deferred@1915796692 after retry RPC after error@81927158) -> (continuation of Deferred@813310628 after retry RPC after error@737180089) -> (continuation of Deferred@1557243407 after retry RPC after error@1215839176) -> (continuation of Deferred@704008033 after retry RPC after error@31704663) -> (continuation of Deferred@1356069306 after retry RPC after error@1501314579) -> (continuation of Deferred@1114304282 after retry RPC after error@1571047550) -> (continuation of Deferred@318075993 after retry RPC after error@708926642) -> (continuation of Deferred@1061582047 after retry RPC after error@1088302321) -> (continuation of Deferred@2033241871 after retry RPC after error@1505015895) -> (continuation of Deferred@1431883570 after retry RPC after error@1683015884) -> (continuation of Deferred@459750398 after retry RPC after error@1735216837)))
14:26:25.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114385658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:25.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:26:25.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:26:25.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:25Z chronyd exiting
14:26:25.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:25.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:26.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:26.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:26.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.058 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:26.088 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:26.089 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:26.089 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:26.090 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.090 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.090 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.090 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.090 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:26.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114386159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:26.170 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:26.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:26:26.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:26.220 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:26.221 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:26.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.222 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.222 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:26.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:26.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:26.227 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:26.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:26.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:26.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:26.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:26.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:26.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:26.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:26.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:26.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:26.228 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:26.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table db2c79c58ac641798f33a8d3e39ada67
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 394fedcdf5784f7f8b123aa3e85deaaa for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ad4d7093598a433b8ed42c0520e061c7 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4652257de6734e049df6608b64d5e2b1 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e3a4162415154ed8ba26ea64fa8f8161 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4d5dd44151694c89a880404d0f161d64 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
14:26:26.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ed72fc8fc2a449d0b2c8519ac4872540 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
14:26:26.261 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
14:26:26.264 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='42785dd0eefaf01fc0fd8e22ebe204057076d90e31b173fa2109560909f0df37'}]
14:26:26.265 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.266 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cc1ff1f1103d61de072dd3a29c7935e0669e27d39096bf2c3c04488a2f198537'}]
14:26:26.267 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.267 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ad2838ce97f3cb7815ff7ee65ffabb240b689eb2e22351d5b020c679950a7a70'}]
14:26:26.268 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.268 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
14:26:26.269 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=4652257de6734e049df6608b64d5e2b1@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:26.269 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:26:26.269 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=e3a4162415154ed8ba26ea64fa8f8161@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:26.273 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='73a69eb15ed60b8c4eea813785857df9daf8fcec02237766e1fc6e5fadaeffc9'}]
14:26:26.278 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.278 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
14:26:26.280 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
14:26:26.284 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299997, tablet=ad4d7093598a433b8ed42c0520e061c7@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:26.285 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299997, tablet=394fedcdf5784f7f8b123aa3e85deaaa@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)[L]]}]
14:26:26.298 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:26.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:26.300 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:26.301 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.301 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:26.306 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.318 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.319 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.326 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.341 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.342 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.350 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.354 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7594eda1, L:/127.0.0.1:39880 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.355 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.371 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:26:26.371 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:26:26.372 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
14:26:26.372 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:26.378 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=4652257de6734e049df6608b64d5e2b1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.378 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [cc1ff1f1103d61de072dd3a29c7935e0669e27d39096bf2c3c04488a2f198537]
14:26:26.378 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cc1ff1f1103d61de072dd3a29c7935e0669e27d39096bf2c3c04488a2f198537]
14:26:26.379 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
14:26:26.379 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
14:26:26.379 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.379 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cc1ff1f1103d61de072dd3a29c7935e0669e27d39096bf2c3c04488a2f198537 finished by subtask 3; deferring removal (restored in pending)
14:26:26.381 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7c6778f4bc0e877341ac32ab7fdf2c9a81682014c9cdfa751e3936ccf7c88932'}]
14:26:26.381 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.383 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.383 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
14:26:26.384 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=4d5dd44151694c89a880404d0f161d64@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473)[L],931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363),e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:26.384 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.389 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.402 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.407 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
14:26:26.408 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
14:26:26.408 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
14:26:26.409 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:26.410 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:26:26.411 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:26:26.411 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
14:26:26.411 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:26:26.412 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:26.412 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
14:26:26.413 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:26.413 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
14:26:26.413 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:26:26.413 [INFO - Thread-64] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:26.413 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:26:26.414 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:26:26.414 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:26:26.415 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.417 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.431 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.436 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4ec813db, L:/127.0.0.1:39898 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.439 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.440 [INFO - Thread-64] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:26.442 [INFO - Thread-64] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:26.448 [DEBUG - Thread-64] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.450 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xba258cd7, L:/127.0.0.1:39884 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.453 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=ad4d7093598a433b8ed42c0520e061c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.453 [INFO - Thread-64] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:26.453 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [73a69eb15ed60b8c4eea813785857df9daf8fcec02237766e1fc6e5fadaeffc9]
14:26:26.453 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [73a69eb15ed60b8c4eea813785857df9daf8fcec02237766e1fc6e5fadaeffc9]
14:26:26.454 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
14:26:26.454 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
14:26:26.456 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:26.456 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:26.456 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:26.457 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.457 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.457 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:26.457 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.457 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.457 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:26.457 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 73a69eb15ed60b8c4eea813785857df9daf8fcec02237766e1fc6e5fadaeffc9 finished by subtask 1; deferring removal (restored in pending)
14:26:26.457 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:26.458 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:26.458 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.458 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='336941af3a7c7a9319c761b4d75ec4a7f0a68be0eb84e4962ec8d4be2d0a63c7'}]
14:26:26.459 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.459 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.459 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
14:26:26.460 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=ed72fc8fc2a449d0b2c8519ac4872540@[6af07db694a34546869fea4ba492b323(127.19.148.2:42473),931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)[L],e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)]}]
14:26:26.462 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.465 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1423a27f, L:/127.0.0.1:39904 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.484 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=394fedcdf5784f7f8b123aa3e85deaaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.484 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [42785dd0eefaf01fc0fd8e22ebe204057076d90e31b173fa2109560909f0df37]
14:26:26.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [42785dd0eefaf01fc0fd8e22ebe204057076d90e31b173fa2109560909f0df37]
14:26:26.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:26:26.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:26:26.486 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 42785dd0eefaf01fc0fd8e22ebe204057076d90e31b173fa2109560909f0df37 finished by subtask 0; deferring removal (restored in pending)
14:26:26.486 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.487 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.490 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:26:26.491 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:26:26.491 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
14:26:26.491 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
14:26:26.492 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@33f6152f
14:26:26.492 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:26.493 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:26:26.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.506 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
14:26:26.506 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
14:26:26.508 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@34e4fea6
14:26:26.511 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.514 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:26.515 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:26.515 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:26.515 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:26.519 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.523 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.528 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] connecting to peer
14:26:26.539 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.544 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd40bfadb, L:/127.0.0.1:39906 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:26.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:26.546 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:26.546 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.547 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:26.550 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.550 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.551 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
14:26:26.557 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=4d5dd44151694c89a880404d0f161d64, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.557 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [7c6778f4bc0e877341ac32ab7fdf2c9a81682014c9cdfa751e3936ccf7c88932]
14:26:26.557 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7c6778f4bc0e877341ac32ab7fdf2c9a81682014c9cdfa751e3936ccf7c88932]
14:26:26.557 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
14:26:26.557 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
14:26:26.558 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7c6778f4bc0e877341ac32ab7fdf2c9a81682014c9cdfa751e3936ccf7c88932 finished by subtask 3; deferring removal (restored in pending)
14:26:26.559 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.560 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.562 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:26:26.563 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:26:26.563 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
14:26:26.563 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
14:26:26.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64d6d032
14:26:26.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:26.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:26:26.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
14:26:26.564 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
14:26:26.566 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:26:26.567 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
14:26:26.567 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
14:26:26.568 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@12636d55
14:26:26.568 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:26.568 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:26:26.568 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:26:26.569 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@321dd964
14:26:26.571 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.571 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
14:26:26.571 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
14:26:26.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f2dccf2
14:26:26.574 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.591 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.591 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.591 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.591 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
14:26:26.622 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=e3a4162415154ed8ba26ea64fa8f8161, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.623 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [ad2838ce97f3cb7815ff7ee65ffabb240b689eb2e22351d5b020c679950a7a70]
14:26:26.623 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ad2838ce97f3cb7815ff7ee65ffabb240b689eb2e22351d5b020c679950a7a70]
14:26:26.623 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
14:26:26.623 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
14:26:26.624 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ad2838ce97f3cb7815ff7ee65ffabb240b689eb2e22351d5b020c679950a7a70 finished by subtask 2; deferring removal (restored in pending)
14:26:26.624 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.625 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:26.636492 20773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.148.1:36125, user_credentials={real_user=slave}} blocked reactor thread for 61033.4us
14:26:26.658 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114386659 for job 4459c5bc8e668403214dd967e9f85899.
14:26:26.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
14:26:26.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
14:26:26.666 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b13c62e
14:26:26.666 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:26.666 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:26:26.666 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
14:26:26.666 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
14:26:26.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a8a4e4d
14:26:26.673 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:26.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.677 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 4459c5bc8e668403214dd967e9f85899 (5086 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:26:26.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:26:26.679 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split cc1ff1f1103d61de072dd3a29c7935e0669e27d39096bf2c3c04488a2f198537 from pending
14:26:26.679 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 7c6778f4bc0e877341ac32ab7fdf2c9a81682014c9cdfa751e3936ccf7c88932 from pending
14:26:26.679 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split ad2838ce97f3cb7815ff7ee65ffabb240b689eb2e22351d5b020c679950a7a70 from pending
14:26:26.679 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 42785dd0eefaf01fc0fd8e22ebe204057076d90e31b173fa2109560909f0df37 from pending
14:26:26.679 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.679 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 73a69eb15ed60b8c4eea813785857df9daf8fcec02237766e1fc6e5fadaeffc9 from pending
14:26:26.679 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 13 complete: removed 5 finished splits from enumerator state
14:26:26.686 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:26.694 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.705 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] Successfully connected to peer
14:26:26.710 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.148.2
14:26:26.720 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:26:26.726 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:26.726 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:26.726 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:26.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.727 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:26.734 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:26.734 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.735 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
14:26:26.735 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe7530edc, L:/127.0.0.1:39910 - R:/127.19.148.2:42473] using SASL/PLAIN
14:26:26.735 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:26.734 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:26.735 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:26.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:26.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.740 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:26.740 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:26.742 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.742 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.742 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.742 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.743 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252526055424001) for scanner KuduScanner(table=replication_test_table, tablet=ed72fc8fc2a449d0b2c8519ac4872540, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:26:26.744 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [336941af3a7c7a9319c761b4d75ec4a7f0a68be0eb84e4962ec8d4be2d0a63c7]
14:26:26.744 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [336941af3a7c7a9319c761b4d75ec4a7f0a68be0eb84e4962ec8d4be2d0a63c7]
14:26:26.744 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
14:26:26.744 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
14:26:26.745 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 336941af3a7c7a9319c761b4d75ec4a7f0a68be0eb84e4962ec8d4be2d0a63c7 finished by subtask 1; deferring removal (restored in pending)
14:26:26.745 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.745 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.756 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.756 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.762 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.763 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.780 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.786 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:26.786 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:26.787 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:26.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:26.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:26.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:26.789 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:26.790 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.790 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.790 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.790 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.791 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.791 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.791 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.791 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.798 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.846 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.846 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.846 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.846 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
14:26:26.847 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.847 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.847 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:26:26.848 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.848 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.848 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
14:26:26.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.62:34807(127.19.148.62:34807)] disconnecting while in state READY
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer 931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)] disconnecting while in state READY
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.61:37523(127.19.148.61:37523)] disconnecting while in state READY
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer master-127.19.148.60:37365(127.19.148.60:37365)] disconnecting while in state READY
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)] disconnecting while in state READY
14:26:26.887 [DEBUG - main] (Connection.java:575) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] disconnecting while in state READY
14:26:26.888 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)] handling channelInactive
14:26:26.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 931d00931ee34b05bad4b01eeef0558e(127.19.148.3:33363)] cleaning up while in state READY due to: connection closed
14:26:26.888 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.148.61:37523(127.19.148.61:37523)] handling channelInactive
14:26:26.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state READY due to: connection closed
14:26:26.889 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.148.60:37365(127.19.148.60:37365)] handling channelInactive
14:26:26.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state READY due to: connection closed
14:26:26.890 [DEBUG - kudu-nio-5] (Connection.java:239) [peer e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)] handling channelInactive
14:26:26.890 [DEBUG - kudu-nio-5] (Connection.java:709) [peer e9a45508766f42ca9a8dd0e64b8cd022(127.19.148.1:36125)] cleaning up while in state READY due to: connection closed
14:26:26.890 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:26.888 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.148.62:34807(127.19.148.62:34807)] handling channelInactive
14:26:26.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state READY due to: connection closed
14:26:26.891 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:26:26.892 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
14:26:26.891 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-5
14:26:26.892 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-4
14:26:26.892 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:26:26.900 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.901 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.910 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.922 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.931 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.934 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.939 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.940 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.946 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] handling channelInactive
14:26:26.946 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6af07db694a34546869fea4ba492b323(127.19.148.2:42473)] cleaning up while in state READY due to: connection closed
14:26:26.946 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-3
14:26:26.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:26.947294 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20384
14:26:26.949 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.951 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:26.951 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.952 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:26.952 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.952 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.952 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.953 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.953 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.953 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.953 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:26.953 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.954 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.954 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.954 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.954 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.955 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.963 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.963 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.963 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.967 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:26.967 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.968 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.977 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.977 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.977 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.978 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.979 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.979 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.979 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.979 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.979 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.979 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.980 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.979 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:26.980 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:26.980 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:26.994 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:26.994 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:26.995 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:26.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:26.996 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:26.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:26.999 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:26.999 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:26.999 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:26.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:26.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.000 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.000 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.000 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.006 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.006 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.007 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.014 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.014 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:27.015 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:27.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.015 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:27.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:27.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:27.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:27.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.015 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:27.016 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:27.016 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.016 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:27.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:27.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:27.016 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:27.016 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:27.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.016 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.016 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.016 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.018 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.018 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.019 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.019 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.019 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.019 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.019 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.019 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.019 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.019 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.030 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.031 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.034 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.034 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.034 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.035 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.035 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.035 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.035 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.035 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.035 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.036 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.036 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.036 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.036 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.036 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.039 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.039 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.039 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.039 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.040 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.040 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.039 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.040 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.040 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.040 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.040 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.040 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.050 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.050 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.050 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.050915 20773 connection.cc:582] client connection to 127.19.148.1:36125 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:27.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.051412 20773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:27.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.056 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.056 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.056 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.056 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.056 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.056 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.057 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.059 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.060 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.060 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.060 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.058399 20580 connection.cc:582] client connection to 127.19.148.1:36125 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:27.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.058946 20580 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:27.066 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:27.066 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:27.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.066 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:27.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.066 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.066 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.066 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.066 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.066 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.067 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.067 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.067 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:27.067 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.067 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.067 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.067 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.067 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.067 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.068 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.074 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.074 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:27.074595 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20557
14:26:27.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.076 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.076 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.074 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.076 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.076 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.077 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.077 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.077 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.077 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.077 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.077 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.078 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.078 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.078 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.080 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.080 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.080 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.080 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.081192 20773 consensus_peers.cc:597] T ed72fc8fc2a449d0b2c8519ac4872540 P 931d00931ee34b05bad4b01eeef0558e -> Peer e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125): Couldn't send request to peer e9a45508766f42ca9a8dd0e64b8cd022. Status: Network error: Client connection negotiation failed: client connection to 127.19.148.1:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:26:27.086 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.086 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.087 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.087 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.087 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.087 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.087 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.087 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.087 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.087 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.096 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.096 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.096 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.096 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.096 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.096 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.097 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.097 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.097 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.097 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.099 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.100 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.100 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.100 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.100 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.100 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.101 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.106 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.106 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.106 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.106 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.106 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.106 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.107 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.117 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.117 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.117 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.117 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.117 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.117 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.118 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.118 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.118 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.118 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.118 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.118 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.118 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.123625 20773 consensus_peers.cc:597] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e -> Peer e9a45508766f42ca9a8dd0e64b8cd022 (127.19.148.1:36125): Couldn't send request to peer e9a45508766f42ca9a8dd0e64b8cd022. Status: Network error: Client connection negotiation failed: client connection to 127.19.148.1:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:26:27.139 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.139 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.139 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.139 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.139 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.140 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.139 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.142 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.142 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.143 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.143 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.144 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.140877 20771 connection.cc:582] client connection to 127.19.148.2:42473 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:26:27.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:27.147948 20771 consensus_peers.cc:597] T e3a4162415154ed8ba26ea64fa8f8161 P 931d00931ee34b05bad4b01eeef0558e -> Peer 6af07db694a34546869fea4ba492b323 (127.19.148.2:42473): Couldn't send request to peer 6af07db694a34546869fea4ba492b323. Status: Network error: Client connection negotiation failed: client connection to 127.19.148.2:42473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:26:27.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:27.152451 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20700
14:26:27.157 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.157 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.157 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.158 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.158 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.158 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.158 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.158 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.158 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.158 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114387159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:27.166 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.167 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.167 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.168 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.168 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.168 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.168 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.168 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.169 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 4459c5bc8e668403214dd967e9f85899 (1651 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:26:27.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
14:26:27.171 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 14 complete: removed split 336941af3a7c7a9319c761b4d75ec4a7f0a68be0eb84e4962ec8d4be2d0a63c7 from pending
14:26:27.171 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 14 complete: removed 1 finished splits from enumerator state
14:26:27.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.174 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.175 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.175 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.175 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.178 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.179 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.179 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.179 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.179 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.179 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.179 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.180 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.180 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.180 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.180 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.180 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.181 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:27.203136 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20060
14:26:27.205 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:27.205 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:27.206 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:27.206 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.206 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.206 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.207 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.207 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.207 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.207 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.207 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.207 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:27.218 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.218 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.218 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.219 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.219 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.219 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.219 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.219 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.219 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.220 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.220 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.220 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.220 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.222 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.222 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.227 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.227 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.227 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.241 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.148.62:34807(127.19.148.62:34807)] handling channelInactive
14:26:27.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state READY due to: connection closed
14:26:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:27.244027 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20130
14:26:27.276 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.276 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.277 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.277 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.277 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.277 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.278 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.148.61:37523(127.19.148.61:37523)] handling channelInactive
14:26:27.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state READY due to: connection closed
14:26:27.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.278 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.278 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:27.279580 20048 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 20261
14:26:27.316 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.148.60:37365(127.19.148.60:37365)] handling channelInactive
14:26:27.317 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state READY due to: connection closed
14:26:27.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.320 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.320 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.320 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.320 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.320 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.320 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.320 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.320 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.321 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.321 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.321 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.321 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.321 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.356 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.356 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.356 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.357 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.357 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.357 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.357 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.357 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.357 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.357 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.357 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.357 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.357 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.426 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.427 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.427 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.427 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.427 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.427 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.427 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.427 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.435 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.435 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.435 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.435 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.435 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.436 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.454 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.454 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.455 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.486 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:27.487 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:27.487 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:27.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:27.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:27.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:27.487 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:27.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.559 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.559 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.559 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.559 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.559 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.559 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.559 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.559 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.559 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.559 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114387658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:27.667 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:27.667 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
14:26:27.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.717 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.717 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.780 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.780 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.780 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.780 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.780 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:27.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:27.966 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:27.966 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:27.966 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:27.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:27.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.967 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.967 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:27.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:27.967 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:27.974 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:27.974 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:27.974 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:27.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:27.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:27.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:27.975 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.099 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.099 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.099 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.100 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.100 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.100 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.100 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.100 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.100 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.112 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:28.112 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:28.112 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:28.112 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:28.112 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:28.113 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:28.113 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:28.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:28.113 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:28.113 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:28.113 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:28.113 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:28.113 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:28.140 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.140 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.140 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.141 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.141 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.146 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:28.146 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:28.146 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:28.147 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:28.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:28.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:28.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:28.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:28.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:28.147 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:28.147 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:28.147 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:28.147 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:28.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114388158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:28.167 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:28.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
14:26:28.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.175 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.175 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.175 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.175 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.175 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.175 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.175 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.175 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.175 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.175 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.175 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.202 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:28.202 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:28.202 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:28.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.202 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.202 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.203 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.203 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.203 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.203 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:28.244 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.245 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.19.148.60:37365(127.19.148.60:37365) for tablet Kudu Master: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.247 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.248 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.249 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.249 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.267 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.268 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.268 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.289 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.308 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.308 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.308 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.308 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.308 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.308 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.308 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.308 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.308 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.308 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.308 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.308 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.309 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.327 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.327 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.327 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.328 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.328 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.328 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.328 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.328 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.328 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.348 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.348 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.348 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.349 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.357 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:28.357 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:28.357 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:28.357 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.357 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.357 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.357 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.357 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.357 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.357 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.357 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.357 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:28.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:28.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:28.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:28.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:28.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:28.369 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:28.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:28.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:28.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:28.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:28.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:28.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:28.369 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:28.428 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.428 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.428 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.428 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.429 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.429 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:28Z chronyd exiting
14:26:28.497 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:28.497 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.497 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:28.497 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:28.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.497 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.497 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.497 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:28.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.497 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.497 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.497 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.498 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.498 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:28.498 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.498 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.498 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.498 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:28.498 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:28.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.528 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.528 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.528 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.528 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.528 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.528 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.528 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.528 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.528 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.528 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.608 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.608 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.608 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.608 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.608 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.608 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.608 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.650 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:28.651 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:28.651 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:28.651 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:28.651 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:28.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:28.651 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:28.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:28.651 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:28.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:28.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:28.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:28.651 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:28.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114388658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:28.664 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=6 ms, finalizationTime=0 ms).
14:26:28.665 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
14:26:28.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:28.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:28.674 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:28.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:28.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:28.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:28.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:28.699 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.699 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.699 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.699 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.700 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.700 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.777 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:28.777 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:28.777 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:28.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:28.777 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.778 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.778 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:28.778 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.778 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.778 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:28.778 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:28.808 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.808 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.808 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.808 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:28.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:28.968 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:28.968 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:28.968 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:28.968 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:28.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.969 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:28.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:28.969 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:29.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:29.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:29.047 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:29.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:29.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:29.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:29.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:29.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:29.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:29.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:29.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:29.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:29.048 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:29.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114389158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:29.165 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:26:29.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
14:26:29.167 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:29.167 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:29.167 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:29.167 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.167 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.167 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.167 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.167 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.167 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.167 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.167 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.167 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.167 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:29.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.287 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:29.287 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:29.287 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:29.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.288 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:29.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:29.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:29.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:29.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.335 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.335 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.335 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.335 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.335 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.336 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:29.348 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:29.348 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:29.348 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:29.348 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.348 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.348 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.348 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.348 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:29.348 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:29.348 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.348 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:29.348 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:29.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.14:26:29.523 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114389523
14:26:29.523 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114389523
14:26:29.529 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:26:29.534 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:26:29.534 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:26:29.534 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:26:29.535 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:26:29.535 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:26:29.539 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:26:29.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114389658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:29.669 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:29.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
14:26:29.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.692 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:29.692 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:29.692 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:29.692 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:29.692 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:29.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:29.692 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:29.692 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:29.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:29.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:29.693 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:29.693 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:29.693 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:29.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.827 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:29.827 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:29.827 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:29.827 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.827 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.827 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.827 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.827 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:29.827 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:29.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:29.828 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:29.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:29.887 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:26:29.888 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:26:29.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:29.891387 22440 mini_oidc.cc:150] Starting JWKS server
14:26:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:29.894590 22440 webserver.cc:533] Webserver started at http://127.0.0.1:33085/ using document root <none> and password file <none>
14:26:29.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:29.894973 22440 mini_oidc.cc:186] Starting OIDC Discovery server
14:26:29.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:29.896945 22440 webserver.cc:533] Webserver started at http://127.0.0.1:37989/ using document root <none> and password file <none>
14:26:29.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:29.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:29.926 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:29.926 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.926 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.926 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:29.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:29.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:29.927 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:29.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:26:29.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:29Z Disabled control of system clock
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:29.963812 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/logs
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data/info.pb
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.62:34045
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.62
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json with env {}
14:26:29.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:30.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:30.008 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:30.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:30.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:30.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:30.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:30.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:30.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:30.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:30.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:30.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:30.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:30.066 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:30.066 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:30.066 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:30.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.067 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.067 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.067 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:30.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114390158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:30.170 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:26:30.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
14:26:30.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.191 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:30.191 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:30.191 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:30.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.192 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.192 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.192 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.192 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.192 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:30.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:30.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:30.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:30.209 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:30.209 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:30.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:30.209 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:30.209 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:30.209 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:30.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:30.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:30.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:30.210 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:30.247 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:30.247 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:30.248 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:30.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:30.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:30.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:30.248 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:30.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:30.248 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:30.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:30.248 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:30.248 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:30.248 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:30.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.293905 22452 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:30.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.294605 22452 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:30.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.295123 22452 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:30.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.330263 22452 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:30.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.330552 22452 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:30.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.330834 22452 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:30.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.331112 22452 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:30.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.331390 22452 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:30.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.331640 22452 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33085/jwks.json
14:26:30.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:30.370923 22452 master_runner.cc:387] Master server non-default flags:
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.62:34045
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data/info.pb
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.62
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/logs
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:30.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:30.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:30.372306 22452 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:30.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:30.373961 22452 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:30.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.385654 22458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:30.439 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:30.439 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:30.439 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:30.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:30.440 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:30.440 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:30.440 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:30.440 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:30.440 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:30.441 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:30.441 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:30.441 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:30.441 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:30.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114390658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:30.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.680 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
14:26:30.682 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
14:26:30.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:30.870 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:30.871 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:30.871 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:30.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:30.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:30.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.872 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.872 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:30.872 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:31.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114391158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:31.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.180 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
14:26:31.182 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
14:26:31.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:31.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:31.187 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:31.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:31.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:31.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:31.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:31.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:31.189 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:31.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:31.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:31.189 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:31.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:31.235 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:31.235 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:31.235 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:31.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.236 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.236 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.237 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:31.285 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:31.285 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:31.285 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:31.286 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:31.286 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:31.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:31.286 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:31.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:31.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:31.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:31.287 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:31.287 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:31.287 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:31.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.376 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:31.376 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:31.377 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:31.377 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.377 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.377 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:31.378 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.378 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.378 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:31.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:31.378 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:31.463 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:31.463 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:31.463 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:31.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.463 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.463 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.463 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.464 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.464 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.464 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.464 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:31.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:31.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:31.577 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:31.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:31.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:31.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:31.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:31.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:31.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:31.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:31.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:31.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:31.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:31.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114391659 for job 4459c5bc8e668403214dd967e9f85899.
14:26:31.672 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:26:31.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
14:26:31.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:30.386801 22459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:31.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.726527 22461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:31.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.729314 22460 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1336 milliseconds
14:26:31.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.730132 22452 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.344s	user 0.467s	sys 0.839s
14:26:31.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.730386 22452 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.344s	user 0.467s	sys 0.839s
14:26:31.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.730557 22452 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:31.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.731653 22452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:31.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.735134 22452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:31.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.736565 22452 hybrid_clock.cc:648] HybridClock initialized: now 1779114391736525 us; error 38 us; skew 500 ppm
14:26:31.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.737461 22452 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:31.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.745414 22452 webserver.cc:533] Webserver started at http://127.21.234.62:37327/ using document root <none> and password file <none>
14:26:31.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.746526 22452 fs_manager.cc:362] Metadata directory not provided
14:26:31.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.746791 22452 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:31.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.747284 22452 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.752595 22452 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data/instance:
14:26:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0bd42280444027a4ec8764edc4a767"
14:26:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:31 on dist-test-slave-1n46"
14:26:31.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.753844 22452 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal/instance:
14:26:31.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0bd42280444027a4ec8764edc4a767"
14:26:31.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:31 on dist-test-slave-1n46"
14:26:31.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.762225 22452 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.005s
14:26:31.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.769497 22468 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:31.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.770910 22452 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
14:26:31.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.771329 22452 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal
14:26:31.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dc0bd42280444027a4ec8764edc4a767"
14:26:31.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:31 on dist-test-slave-1n46"
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.771713 22452 fs_report.cc:389] FS layout report
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data/data
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:31.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.842549 22452 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:31.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.844072 22452 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:31.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.844521 22452 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:31.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:31.888 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:31.889 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:31.889 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:31.889 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.889 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.889 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.889 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.889 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.889 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.890 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:31.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.923630 22452 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.62:34045
14:26:31.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.923700 22519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.62:34045 every 8 connection(s)
14:26:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.926613 22452 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/data/info.pb
14:26:31.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.927597 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 22452
14:26:31.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.928018 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-0/wal/instance
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.931890 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/logs
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data/info.pb
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.61:40633
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.61
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:31.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json with env {}
14:26:31.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.935443 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:31.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.946863 22520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } has no permanent_uuid. Determining permanent_uuid...
14:26:31.960 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:26:31.960 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:26:31.961 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:26:31.961 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:31.961 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
14:26:31.962 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
14:26:31.962 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
14:26:31.963 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:26:31.964 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
14:26:31.964 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:26:31.964 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
14:26:31.964 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:26:31.965 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
14:26:31.965 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:26:31.965 [INFO - Thread-66] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:31.965 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:26:31.965 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:31.965 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:31.966 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:26:31.966 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:26:31.966 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:26:31.966 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:26:31.967 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:31.967 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
14:26:31.967 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
14:26:31.968 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@182315d9
14:26:31.968 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:31.968 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:26:31.968 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
14:26:31.969 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:31.970 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:31.970 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:31.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.970 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:26:31.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.970 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:31.970 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:31.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.971 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.971 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:31.971 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:31.971 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:26:31.971 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
14:26:31.971 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
14:26:31.971 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
14:26:31.972 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c60aacb
14:26:31.973 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@475bc9c
14:26:31.973 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:31.973 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:26:31.973 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:26:31.973 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:26:31.976 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:31.977 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
14:26:31.976 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:26:31.978 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
14:26:31.978 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:26:31.979 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29838ca8
14:26:31.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:31.979853 22520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } has no permanent_uuid. Determining permanent_uuid...
14:26:31.980 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@79303749
14:26:31.980 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:31.980 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:26:31.980 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
14:26:31.980 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
14:26:31.982 [INFO - Thread-66] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:31.982 [INFO - Thread-66] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.982904 22472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:31.985 [DEBUG - Thread-66] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:31.985 [INFO - Thread-66] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:31.985 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:31.986 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@12f75998
14:26:31.986 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:31.988 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:31.989 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
14:26:31.989 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
14:26:31.989 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f8d3c29
14:26:31.989 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:31.989 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:26:31.990 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
14:26:31.990 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
14:26:31.992 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a53dcaf
14:26:31.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:31.992738 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:31.993 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:31.994 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:31.994 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:31.994 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:31.994 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:31.994 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:31.994 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:31.994 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:31.994 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.995 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.995 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:31.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.995 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:31.995 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:31.995 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:31.998 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:31.998 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:31.999 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:31.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:31.999 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.000 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.000 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.001 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.002 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.002 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.002 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.002 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.003 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.003 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.004 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.006 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.006 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.010 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.010 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.011 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.011 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.011 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.011 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.011 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.012 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.012 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.012 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.012 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.012 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.013 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.013 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.014 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.014 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.014 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.014 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.015 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.018 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.018 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.018 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.018 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.018 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.019 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.019 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.019 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.019 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.019 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.020 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.020 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.021 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.021 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.021 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.021 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.021 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.022 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.022 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.023 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.023 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.027 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.027 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.027 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.028 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.028 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.028 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.028 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.028 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.028 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.031 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:32.031 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:32.032 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:32.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:32.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:32.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:32.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:32.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:32.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:32.032 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:32.032 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:32.032 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:32.032 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:32.033 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.033 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.034 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.035 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.039 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.039 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.040 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.040 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.040 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.040 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.041 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.041 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.042 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.042 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.042 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.042 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.042241 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 1
14:26:32.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.046830 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:32.047 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.047 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.047 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.047 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.047 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.053 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.054 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.054 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.054 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.054 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.054 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.054 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.054 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.054 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.054 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.054 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.054 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.059 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.059 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.059 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.059 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.059 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.060 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.060 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.060 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.060 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.060 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.061 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.061 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.061 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.061 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.061 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.062 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.062 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.062 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.062 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.062 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:32.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:32.066 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:32.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:32.066 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:32.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:32.066 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:32.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:32.066 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:32.066 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:32.066 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:32.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:32.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:32.067 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.067 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.067 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.068 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.068 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.074 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.074 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.074 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.074 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.074 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.078 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.079 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.079 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.079 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.079 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.081 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.081 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.081 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.081 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.081 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.081 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.081 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.081 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.081 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.081 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.081 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.081 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.081 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.081 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.082 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.082 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.082 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.086 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.086 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.086 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.093 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.093 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.093 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.093 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.093 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.093 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.093 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.093 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.093 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.093 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.100 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.100 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.100 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.101 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.107 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.114 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.114 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.114 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.114 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.114 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.114 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.115250 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 2
14:26:32.118 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.118 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.118 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.118 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.119 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.119493 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:32.120 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.120 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.120 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.120 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.121 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.121 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.121 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.121 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.121 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.121 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.141 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.141 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.141 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.141 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.141 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.141 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.141 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.141 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.142 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.153 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.153 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.153 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.153 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.153 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.153 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.153 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114392158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:32.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.159 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.159 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.160 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:32.160 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:32.160 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:32.160 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:32.160 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:32.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:32.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:32.160 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:32.161 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:32.161 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:32.161 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:32.161 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:32.161 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:32.163 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.163 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.163 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.163 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.163 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.163 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.163 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.164 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.164 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.164 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.164 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.166 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.166 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.167 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.167 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.167 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.167 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.167 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.167 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.167 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.167 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.167 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.167 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.168 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:26:32.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
14:26:32.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.210960 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 3
14:26:32.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.214900 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:32.220 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.221 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.221 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.222 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.240 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.240 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.240 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.240 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.241 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.247 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.247 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.247 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.248 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.248 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.248 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.248 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.248 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.253 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.253 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.253 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.253 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.253 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.253 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.253 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.279 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.279 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.279 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.279 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.279 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.288735 22522 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:32.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.289233 22522 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:32.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.289749 22522 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:32.318 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.319 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.319 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.319 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.319 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.319 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.324177 22522 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:32.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.324446 22522 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:32.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.324676 22522 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:32.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.324847 22522 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:32.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.325059 22522 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:32.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.325197 22522 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33085/jwks.json
14:26:32.340 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.340 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.340 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.341 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.341 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.358309 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 4
14:26:32.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.362408 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.363456 22522 master_runner.cc:387] Master server non-default flags:
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.61:40633
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json
14:26:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data/info.pb
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.61
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/logs
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:32.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:32.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.364832 22522 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:32.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.366466 22522 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:32.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.377180 22585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:32.393 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.393 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.393 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.393 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.394 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.394 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.487 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.487 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.487 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.488 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.488 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.488 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.488 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.600 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.600 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.601 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.602 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.602 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.603 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.635 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:32.635 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:32.635 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:32.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:32.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:32.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:32.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:32.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:32.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:32.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:32.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:32.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:32.637 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:32.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114392658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:32.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:32.661824 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 5
14:26:32.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.681 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.681 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.682 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.683 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.683 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.683 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.686 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=28 ms, finalizationTime=0 ms).
14:26:32.688 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
14:26:32.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.690868 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:32.747 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.747 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.747 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.749 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.759 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.759 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.759 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.759 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.759 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.760 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:32.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:32.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:32.854 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.854 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.854 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:32.854 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.854 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.854 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:32.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:32.855 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:32.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:32.923 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.923 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.924 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.924 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.925 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.939 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.939 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.939 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.940 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:32.966 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:32.966 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:32.966 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:32.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:32.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:32.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:32.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:32.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:32.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:32.967 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:32.967 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:32.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:32.968 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:32.968 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:32.968 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:32.968 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:32.969 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.969 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.969 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:32.969 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:32.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:32.970 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:33.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:33.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:33.125 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:33.126 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:33.126 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:33.126 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:33.126 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:33.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:33.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:33.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:33.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:33.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:33.127 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:33.128 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:33.128 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:33.128 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:33.128 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:33.128 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:33.128 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:33.129 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:33.129 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:33.129 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:33.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:33.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:33.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:33.129 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:33.132 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:33.132 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:33.132 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:33.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:33.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:33.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:33.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:33.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:33.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:33.133 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:33.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:33.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:33.133 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:33.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114393158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:33.171 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:26:33.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
14:26:33.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.238432 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 6
14:26:33.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:33.268981 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.61:40633: Network error: Client connection negotiation failed: client connection to 127.21.234.61:40633: connect: Connection refused (error 111)
14:26:33.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.360 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.441 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:33.442 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:33.442 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:33.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.443 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.443 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.443 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.443 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.443 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.443 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.443 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:33.493 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:33.493 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:33.493 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:33.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:33.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:33.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:33.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:33.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:33.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:33.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:33.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:33.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:33.495 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:33.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.522 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:33.522 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:33.522 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:33.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.523 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.524 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:33.528 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:33.528 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:33.528 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:33.528 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.528 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.528 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.529 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.529 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.529 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.529 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.529 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.529 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:33.581 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:33.581 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:33.581 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:33.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:33.582 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.582 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:33.582 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.582 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.582 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:33.582 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:33.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114393658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:33.717 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.720 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=61 ms, finalizationTime=0 ms).
14:26:33.721 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
14:26:33.735 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:33.735 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:33.735 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:33.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.736 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:33.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:32.378508 22586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:33.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:33.758981 22588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:33.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:33.759220 22587 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1379 milliseconds
14:26:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:33.763249 22522 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.385s	user 0.458s	sys 0.896s
14:26:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:33.763509 22522 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.386s	user 0.458s	sys 0.896s
14:26:33.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.763769 22522 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:33.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.764887 22522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:33.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.768075 22522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:33.769 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:33.769 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:33.769 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:33.769 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:33.769 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:33.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.769518 22522 hybrid_clock.cc:648] HybridClock initialized: now 1779114393769391 us; error 101 us; skew 500 ppm
14:26:33.769 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:33.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:33.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:33.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:33.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:33.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:33.770 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:33.770 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:33.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.770516 22522 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:33.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.779268 22522 webserver.cc:533] Webserver started at http://127.21.234.61:37881/ using document root <none> and password file <none>
14:26:33.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.780294 22522 fs_manager.cc:362] Metadata directory not provided
14:26:33.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.780587 22522 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:33.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.781157 22522 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:33.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.786368 22522 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data/instance:
14:26:33.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4da7eae8e7ef43ae8d904db0d9b0c474"
14:26:33.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:33 on dist-test-slave-1n46"
14:26:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.787657 22522 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal/instance:
14:26:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4da7eae8e7ef43ae8d904db0d9b0c474"
14:26:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:33 on dist-test-slave-1n46"
14:26:33.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.801265 22522 fs_manager.cc:696] Time spent creating directory manager: real 0.013s	user 0.004s	sys 0.008s
14:26:33.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.808326 22597 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:33.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.809696 22522 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.002s
14:26:33.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.810055 22522 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal
14:26:33.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4da7eae8e7ef43ae8d904db0d9b0c474"
14:26:33.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:33 on dist-test-slave-1n46"
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.810393 22522 fs_report.cc:389] FS layout report
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data/data
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:33.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.838 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:33.838 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:33.838 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:33.839 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.839 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.839 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.839 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.839 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.839 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.839 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.839 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.840 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:33.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:33.921 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:33.921 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:33.921 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:33.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.896988 22522 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:33.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.898757 22522 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:33.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:33.899299 22522 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:33.922 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:33.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:33.922 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.922 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.922 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:33.922 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:33.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:33.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:33.948 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:33.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.949 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:33.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:33.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:33.949 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:34.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.015456 22522 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.61:40633
14:26:34.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.015529 22648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.61:40633 every 8 connection(s)
14:26:34.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.018292 22522 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/data/info.pb
14:26:34.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.024609 22649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:34.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.024957 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 22522
14:26:34.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.025415 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-1/wal/instance
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.028028 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/logs
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data/info.pb
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.60:44393
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.60
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:34.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:34.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:34.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json with env {}
14:26:34.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.036087 22649 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } has no permanent_uuid. Determining permanent_uuid...
14:26:34.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.057233 22649 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } has no permanent_uuid. Determining permanent_uuid...
14:26:34.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.072021 22649 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
14:26:34.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.074158 22601 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.078419 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.127817 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 1
14:26:34.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.131880 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.146 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:34.146 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:34.146 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:34.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.146 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.146 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:34.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114394158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:34.166 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:34.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
14:26:34.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.200197 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 2
14:26:34.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.204613 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.237 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:34.237 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:34.237 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:34.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:34.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:34.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:34.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:34.238 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:34.238 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:34.238 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:34.238 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:34.238 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:34.238 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:34.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.296023 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 3
14:26:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.300421 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.329552 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } attempt: 7
14:26:34.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.341454 22520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
14:26:34.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.346741 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.347 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:34.347 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:34.347 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:34.348 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.348 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.348 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.348 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.348 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.348 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.348 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:34.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.365901 22651 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:34.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.366670 22651 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:34.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.367226 22651 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:34.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.400591 22651 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:34.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.400902 22651 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:34.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.401165 22651 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:34.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.401367 22651 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:34.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.401547 22651 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:34.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.401736 22651 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33085/jwks.json
14:26:34.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.405108 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 1
14:26:34.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.409384 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.419 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:34.419 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:34.419 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:34.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.419 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.419 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.443858 22651 master_runner.cc:387] Master server non-default flags:
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.60:44393
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33085/jwks.json
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data/info.pb
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.60
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/logs
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:34.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.443828 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 4
14:26:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.445403 22651 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:34.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.447268 22651 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:34.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.448237 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.459635 22663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:34.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.490828 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 2
14:26:34.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.496915 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.540 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:34.541 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:34.541 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:34.541 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.541 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.541 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:34.542 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.542 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.542 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:34.542 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.542 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.542 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:34.542 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:34.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.582433 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 3
14:26:34.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.589605 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.660 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114394658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:34.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:26:34.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.675 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
14:26:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.730059 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 4
14:26:34.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.738224 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:34.747615 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 5
14:26:34.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.756428 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:34.770 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:34.770 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:34.771 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:34.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.771 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.771 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.771 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.771 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.771 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.772 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.772 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:34.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.859 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:34.965 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:34.965 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:34.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:34.967 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:34.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:34.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.968 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:34.968 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:34.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.021752 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 5
14:26:35.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.027657 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:35.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:35.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:35.093 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:35.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:35.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:35.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:35.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:35.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:35.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:35.094 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:35.094 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:35.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:35.094 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:35.106 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:35.106 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:35.106 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:35.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:35.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114395158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:35.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.175 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
14:26:35.177 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:35.177 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:35.177 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:35.178 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.178 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.178 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.179 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:35.182 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
14:26:35.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:35.208 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:35.209 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:35.209 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.209 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.209 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.210 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.210 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.210 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.210 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.210 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.210 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.211 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:35.214 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:35.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.214 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:35.216 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:35.216 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.216 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.217 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.217 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.217 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.217 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:35.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:35.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:35.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:35.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.236 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:35.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.236 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.236 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:35.237 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:35.237 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.304040 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 6
14:26:35.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.336160 22649 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:35.339 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:35.339 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:35.339 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:35.340 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.340 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.340 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.341 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:35.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.447 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:35.447 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:35.447 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:35.448 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.448 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.448 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:35.449 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.449 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.449 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:35.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.449 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.449 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:35.449 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:35.487 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:35.487 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:35.488 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:35.488 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:35.488 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:35.488 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:35.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:35.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:35.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:35.489 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:35.489 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:35.489 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:35.489 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:35.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.580111 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 6
14:26:35.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.608397 22520 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.234.60:44393: Network error: Client connection negotiation failed: client connection to 127.21.234.60:44393: connect: Connection refused (error 111)
14:26:35.639 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:35.640 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:35.640 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:35.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:35.641 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.641 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:35.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:35.642 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:35.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114395659 for job 4459c5bc8e668403214dd967e9f85899.
14:26:35.675 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.675 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:26:35.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
14:26:35.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:35.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:34.460369 22664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:35.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.873318 22662 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 22651
14:26:35.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.925361 22651 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.466s	user 0.566s	sys 0.895s
14:26:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.927915 22651 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.469s	user 0.566s	sys 0.895s
14:26:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.928167 22666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:35.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:35.930378 22665 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1465 milliseconds
14:26:35.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.930388 22651 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:35.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.931730 22651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:35.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.934182 22651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:35.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.935633 22651 hybrid_clock.cc:648] HybridClock initialized: now 1779114395935588 us; error 36 us; skew 500 ppm
14:26:35.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.936502 22651 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:35.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.942850 22651 webserver.cc:533] Webserver started at http://127.21.234.60:35601/ using document root <none> and password file <none>
14:26:35.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.943710 22651 fs_manager.cc:362] Metadata directory not provided
14:26:35.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.943887 22651 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:35.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.944263 22651 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:35.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.948920 22651 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data/instance:
14:26:35.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffb7ed84877d4912ab211b31861fd8df"
14:26:35.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:35 on dist-test-slave-1n46"
14:26:35.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.950194 22651 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal/instance:
14:26:35.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffb7ed84877d4912ab211b31861fd8df"
14:26:35.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:35 on dist-test-slave-1n46"
14:26:35.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.958061 22651 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
14:26:35.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.963783 22677 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:35.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.964632 22651 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.964939 22651 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffb7ed84877d4912ab211b31861fd8df"
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:35 on dist-test-slave-1n46"
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:35.965255 22651 fs_report.cc:389] FS layout report
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal
14:26:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data/data
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:36.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:36.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:36.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:36.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:36.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:36.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:36.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:36.027 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:36.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:36.027 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:36.027 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:36.027 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:36.027 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:36.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.028182 22651 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:36.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.029662 22651 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:36.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.030150 22651 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:36.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:36.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:36.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:36.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:36.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:36.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:36.073 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:36.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:36.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:36.074 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:36.074 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:36.074 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:36.074 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:36.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.109130 22651 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.60:44393
14:26:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.109191 22728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.60:44393 every 8 connection(s)
14:26:36.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.112247 22651 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/data/info.pb
14:26:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.118731 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 22651
14:26:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.118829 22729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.119220 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/master-2/wal/instance
14:26:36.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.135456 22729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } has no permanent_uuid. Determining permanent_uuid...
14:26:36.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114396158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:36.174 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.175201 22729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } has no permanent_uuid. Determining permanent_uuid...
14:26:36.176 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
14:26:36.176 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
14:26:36.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.185336 22729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
14:26:36.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.200906 22729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: Bootstrap starting.
14:26:36.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.207516 22729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: Neither blocks nor log segments found. Creating new log.
14:26:36.208 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:36.208 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:36.208 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:36.208 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.208 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.208 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.208 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.208 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:36.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:36.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:36.209 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:36.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:36.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:36.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:36.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:36.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:36.209 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:36.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:36.209 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:36.209 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:36.209 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:36.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.209837 22729 log.cc:826] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: Log is configured to *not* fsync() on all Append() calls
14:26:36.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.214265 22729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: No bootstrap required, opened a new log
14:26:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.233382 22729 raft_consensus.cc:359] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.234177 22729 raft_consensus.cc:385] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.234467 22729 raft_consensus.cc:740] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb7ed84877d4912ab211b31861fd8df, State: Initialized, Role: FOLLOWER
14:26:36.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.235317 22729 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.238466 22738 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.239352 22738 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.240253 22729 sys_catalog.cc:565] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: configured and running, proceeding with master startup.
14:26:36.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.250692 22738 raft_consensus.cc:493] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:36.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.251277 22738 raft_consensus.cc:515] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.254300 22738 leader_election.cc:290] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc0bd42280444027a4ec8764edc4a767 (127.21.234.62:34045), 4da7eae8e7ef43ae8d904db0d9b0c474 (127.21.234.61:40633)
14:26:36.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:36.270292 22749 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:26:36.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:36.270579 22749 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:26:36.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:36.285120 22683 tablet.cc:2404] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:36.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.263520 22651 master_runner.cc:187] Error getting master registration for 127.21.234.62:34045: OK, instance_id { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" instance_seqno: 1779114391903208 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:36.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.298507 22651 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:36.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.352 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:36.352 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:36.352 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:36.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:36.352 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:36.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:36.352 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:36.352 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:36.352 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:36.352 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:36.352 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:36.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:36.352 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:36.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.396749 22649 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 7
14:26:36.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.418267 22649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: Bootstrap starting.
14:26:36.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.425856 22649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: Neither blocks nor log segments found. Creating new log.
14:26:36.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.428407 22649 log.cc:826] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: Log is configured to *not* fsync() on all Append() calls
14:26:36.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.433691 22649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: No bootstrap required, opened a new log
14:26:36.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.463110 22649 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.463873 22649 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:36.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.464128 22649 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4da7eae8e7ef43ae8d904db0d9b0c474, State: Initialized, Role: FOLLOWER
14:26:36.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.465042 22649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.468081 22753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.468824 22753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.469719 22649 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: configured and running, proceeding with master startup.
14:26:36.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.469893 22624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffb7ed84877d4912ab211b31861fd8df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" is_pre_election: true
14:26:36.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.470749 22624 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb7ed84877d4912ab211b31861fd8df in term 0.
14:26:36.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.472616 22681 leader_election.cc:304] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4da7eae8e7ef43ae8d904db0d9b0c474, ffb7ed84877d4912ab211b31861fd8df; no voters: 
14:26:36.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.473629 22738 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:36.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.473984 22738 raft_consensus.cc:493] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:36.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.474282 22738 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 0 FOLLOWER]: Advancing to term 1
14:26:36.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.480571 22738 raft_consensus.cc:515] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.483441 22738 leader_election.cc:290] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [CANDIDATE]: Term 1 election: Requested vote from peers dc0bd42280444027a4ec8764edc4a767 (127.21.234.62:34045), 4da7eae8e7ef43ae8d904db0d9b0c474 (127.21.234.61:40633)
14:26:36.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.484704 22624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffb7ed84877d4912ab211b31861fd8df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474"
14:26:36.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.485240 22624 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 0 FOLLOWER]: Advancing to term 1
14:26:36.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.497213 22624 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb7ed84877d4912ab211b31861fd8df in term 1.
14:26:36.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.498160 22681 leader_election.cc:304] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4da7eae8e7ef43ae8d904db0d9b0c474, ffb7ed84877d4912ab211b31861fd8df; no voters: 
14:26:36.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.498863 22738 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 1 FOLLOWER]: Leader election won for term 1
14:26:36.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.500828 22738 raft_consensus.cc:697] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [term 1 LEADER]: Becoming Leader. State: Replica: ffb7ed84877d4912ab211b31861fd8df, State: Running, Role: LEADER
14:26:36.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.501721 22738 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.511297 22759 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffb7ed84877d4912ab211b31861fd8df. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.512367 22759 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: This master's current role is: LEADER
14:26:36.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.518183 22763 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:26:36.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.525641 22763 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:26:36.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.543931 22624 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [term 1 FOLLOWER]: Refusing update from remote peer ffb7ed84877d4912ab211b31861fd8df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:36.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.545539 22759 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:36.550 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:36.550 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:36.550 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:36.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.551 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.551 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.551 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.552 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.552 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.552 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.552 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:36.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.550906 22768 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:26:36.553 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [59ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [109ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [115ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [116ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [125ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [131ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [131ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [155ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [182ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [200ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [289ms] refreshing cache from master, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [291ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [323ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [363ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [363ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2163ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3560ms] refreshing cache from master, [3560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3561ms] too many traces: truncated at 100 traces, deferred=Deferred@1702754220(state=PENDING, result=null, callback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513), errback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513)))
14:26:36.555 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:26:36.555 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [59ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [109ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [115ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [116ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [125ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [131ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [131ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [155ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [182ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [200ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [289ms] refreshing cache from master, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [291ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [323ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [363ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [363ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2163ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3560ms] refreshing cache from master, [3560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3561ms] too many traces: truncated at 100 traces, deferred=Deferred@1702754220(state=PENDING, result=null, callback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513), errback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:36.556 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
14:26:36.565 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:26:36.570 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [59ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [109ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [115ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [116ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [125ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [131ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [131ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [155ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [155ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [182ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [200ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [289ms] refreshing cache from master, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [290ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [291ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [323ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [363ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [363ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2163ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3560ms] refreshing cache from master, [3560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3561ms] too many traces: truncated at 100 traces, deferred=Deferred@1702754220(state=PENDING, result=null, callback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513), errback=(continuation of Deferred@1246437641 after retry RPC after error@1592185170) -> (continuation of Deferred@1447753039 after retry RPC after error@1551939773) -> (continuation of Deferred@1339066701 after retry RPC after error@659864996) -> (continuation of Deferred@641062028 after retry RPC after error@2141836711) -> (continuation of Deferred@880321022 after retry RPC after error@910394184) -> (continuation of Deferred@1054519480 after retry RPC after error@267341353) -> (continuation of Deferred@2120841595 after retry RPC after error@1419439165) -> (continuation of Deferred@1068423526 after retry RPC after error@1254446780) -> (continuation of Deferred@2136103998 after retry RPC after error@2091560173) -> (continuation of Deferred@889597943 after retry RPC after error@1427570525) -> (continuation of Deferred@944306797 after retry RPC after error@296547405) -> (continuation of Deferred@357636120 after retry RPC after error@2011165176) -> (continuation of Deferred@138143484 after retry RPC after error@2118346026) -> (continuation of Deferred@1674523426 after retry RPC after error@1805078162) -> (continuation of Deferred@1020025114 after retry RPC after error@1497567644) -> (continuation of Deferred@1133473717 after retry RPC after error@306006664) -> (continuation of Deferred@1290261852 after retry RPC after error@225043117) -> (continuation of Deferred@891541106 after retry RPC after error@1295164244) -> (continuation of Deferred@1057866395 after retry RPC after error@2100503389) -> (continuation of Deferred@1443424975 after retry RPC after error@242797401) -> (continuation of Deferred@1605421335 after retry RPC after error@1006448759) -> (continuation of Deferred@716368725 after retry RPC after error@1649991513)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:36.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
14:26:36.571 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
14:26:36.571 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RUNNING to RESTARTING.
14:26:36.572 [WARN - flink-pekko.actor.default-dispatcher-4] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
14:26:36.573 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:36.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.579895 22753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffb7ed84877d4912ab211b31861fd8df. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.581316 22753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.598266 22766 mvcc.cc:204] Tried to move back new op lower bound from 7287252568227373056 to 7287252568081678336. Current Snapshot: MvccSnapshot[applied={T|T < 7287252568227373056}]
14:26:36.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.600816 22769 mvcc.cc:204] Tried to move back new op lower bound from 7287252568227373056 to 7287252568081678336. Current Snapshot: MvccSnapshot[applied={T|T < 7287252568227373056}]
14:26:36.605 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:36.605 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:36.605 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:36.605 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.605 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.606 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.606 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.606 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.606 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.606 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.606 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:36.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.607429 22753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.608165 22753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.619845 22759 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.620555 22759 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: This master's current role is: LEADER
14:26:36.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.629040 22763 catalog_manager.cc:1383] Generated new cluster ID: ec5f41016bf14af4851f01a4eb03cec1
14:26:36.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.629313 22763 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:26:36.640 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:36.641 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:36.641 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:36.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.642 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:36.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.641952 22520 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } attempt: 7
14:26:36.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114396658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:36.661 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:36.661 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:36.661 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:36.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.662 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:36.663 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:36.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.663 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.663 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:36.663 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:36.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.671379 22763 catalog_manager.cc:1406] Generated new certificate authority record
14:26:36.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.673337 22763 catalog_manager.cc:1540] Loading token signing keys...
14:26:36.677 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:26:36.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
14:26:36.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.561690 22522 master_runner.cc:187] Error getting master registration for 127.21.234.62:34045: OK, instance_id { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" instance_seqno: 1779114391903208 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:36.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.685956 22522 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:36.695 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:36.695 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:36.695 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:36.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:36.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:36.697 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:36.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:36.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:36.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:36.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:36.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:36.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:36.697 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:36.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.701536 22520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: Bootstrap starting.
14:26:36.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.707319 22763 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df: Generated new TSK 0
14:26:36.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.709501 22763 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:26:36.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.718246 22520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: Neither blocks nor log segments found. Creating new log.
14:26:36.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.728242 22520 log.cc:826] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: Log is configured to *not* fsync() on all Append() calls
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.730160 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/logs
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data/info.pb
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:36.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.1:0
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.1
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.1
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:36.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.741204 22520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: No bootstrap required, opened a new log
14:26:36.747 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:36.748 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:36.748 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:36.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.748 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:36.748 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.748 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:36.748 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.748 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:36.749 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.770828 22520 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.771814 22520 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:36.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.772114 22520 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0bd42280444027a4ec8764edc4a767, State: Initialized, Role: FOLLOWER
14:26:36.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.772974 22520 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } }
14:26:36.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.776712 22776 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.778717 22520 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: configured and running, proceeding with master startup.
14:26:36.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.779414 22493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [term 0 FOLLOWER]: Advancing to term 1
14:26:36.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.779995 22495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffb7ed84877d4912ab211b31861fd8df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0bd42280444027a4ec8764edc4a767" is_pre_election: true
14:26:36.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.780670 22494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffb7ed84877d4912ab211b31861fd8df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0bd42280444027a4ec8764edc4a767"
14:26:36.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.784941 22776 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.787686 22493 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [term 1 FOLLOWER]: Refusing update from remote peer ffb7ed84877d4912ab211b31861fd8df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:36.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.789222 22738 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:36.805 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:36.805 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:36.805 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:36.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:36.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:36.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:36.807 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:36.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28611), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [32ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [35ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [40ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [103ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [108ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [111ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [111ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [128ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [142ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [142ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [165ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [166ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [166ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [243ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [341ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [821ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [822ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1503ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3142ms] refreshing cache from master, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3144ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@857864484(state=PENDING, result=null, callback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698), errback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698)))
14:26:36.809 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:26:36.809 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28611), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [32ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [35ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [40ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [103ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [108ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [111ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [111ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [128ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [142ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [142ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [165ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [166ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [166ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [243ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [341ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [821ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [822ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1503ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3142ms] refreshing cache from master, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3144ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@857864484(state=PENDING, result=null, callback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698), errback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:36.810 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
14:26:36.812 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:26:36.814 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28611), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [32ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [35ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [40ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [103ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [108ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [111ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [111ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [128ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [128ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [142ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [142ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [165ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [166ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [166ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [243ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [341ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [821ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [822ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1503ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3142ms] refreshing cache from master, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3144ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3144ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3981ms] too many traces: truncated at 100 traces, deferred=Deferred@857864484(state=PENDING, result=null, callback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698), errback=(continuation of Deferred@6725097 after retry RPC after error@137799740) -> (continuation of Deferred@555181012 after retry RPC after error@490952203) -> (continuation of Deferred@704518559 after retry RPC after error@347354068) -> (continuation of Deferred@237497173 after retry RPC after error@156440468) -> (continuation of Deferred@1345902016 after retry RPC after error@1697085056) -> (continuation of Deferred@1416320050 after retry RPC after error@1167398556) -> (continuation of Deferred@1393904955 after retry RPC after error@223916719) -> (continuation of Deferred@52215282 after retry RPC after error@1850768123) -> (continuation of Deferred@391483039 after retry RPC after error@1599118096) -> (continuation of Deferred@969231909 after retry RPC after error@1412394052) -> (continuation of Deferred@1865756968 after retry RPC after error@879144901) -> (continuation of Deferred@666987274 after retry RPC after error@144932602) -> (continuation of Deferred@1322885815 after retry RPC after error@1329607726) -> (continuation of Deferred@1668648951 after retry RPC after error@1890744781) -> (continuation of Deferred@1946005878 after retry RPC after error@1037179491) -> (continuation of Deferred@1914122265 after retry RPC after error@285758343) -> (continuation of Deferred@266348241 after retry RPC after error@583808076) -> (continuation of Deferred@1771065332 after retry RPC after error@978828586) -> (continuation of Deferred@873447967 after retry RPC after error@2007166598) -> (continuation of Deferred@480698473 after retry RPC after error@463446074) -> (continuation of Deferred@1363838572 after retry RPC after error@838636573) -> (continuation of Deferred@452104163 after retry RPC after error@2089444087) -> (continuation of Deferred@2037834476 after retry RPC after error@746573219) -> (continuation of Deferred@578605656 after retry RPC after error@223248698)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:36.815 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:36.816 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
14:26:36.816 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
14:26:36.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:36.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.862742 22784 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.863478 22784 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.863991 22776 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffb7ed84877d4912ab211b31861fd8df. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:36.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.864585 22776 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767 [sys.catalog]: This master's current role is: FOLLOWER
14:26:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.889940 22792 catalog_manager.cc:1295] Loaded cluster ID: ec5f41016bf14af4851f01a4eb03cec1
14:26:36.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.890319 22792 catalog_manager.cc:1588] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: loading cluster ID for follower catalog manager: success
14:26:36.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.899747 22792 catalog_manager.cc:1610] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: acquiring CA information for follower catalog manager: success
14:26:36.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:36.905797 22792 catalog_manager.cc:1638] T 00000000000000000000000000000000 P dc0bd42280444027a4ec8764edc4a767: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:37.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:37.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:37.015 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:37.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.016 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:37.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:37.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:37.057 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:37.057 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.057 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.058 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.058 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.058 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.058 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:37.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114397158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:37.166 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:37.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
14:26:37.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.176532 22738 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffb7ed84877d4912ab211b31861fd8df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0bd42280444027a4ec8764edc4a767" member_type: VOTER last_known_addr { host: "127.21.234.62" port: 34045 } } peers { permanent_uuid: "4da7eae8e7ef43ae8d904db0d9b0c474" member_type: VOTER last_known_addr { host: "127.21.234.61" port: 40633 } } peers { permanent_uuid: "ffb7ed84877d4912ab211b31861fd8df" member_type: VOTER last_known_addr { host: "127.21.234.60" port: 44393 } } }
14:26:37.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.177263 22738 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb7ed84877d4912ab211b31861fd8df [sys.catalog]: This master's current role is: LEADER
14:26:37.226 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:37.226 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:37.226 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:37.227 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:37.227 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:37.227 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:37.227 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:37.227 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:37.227 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:37.227 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:37.227 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:37.227 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:37.227 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:37.228 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29058), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [33ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [43ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [43ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [90ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [100ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [101ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [147ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [184ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [184ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [443ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1382ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2922ms] too many traces: truncated at 100 traces, deferred=Deferred@1575727358(state=PENDING, result=null, callback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497), errback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497)))
14:26:37.229 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:26:37.230 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29058), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [33ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [43ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [43ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [90ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [100ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [101ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [147ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [184ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [184ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [443ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1382ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2922ms] too many traces: truncated at 100 traces, deferred=Deferred@1575727358(state=PENDING, result=null, callback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497), errback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:37.230 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
14:26:37.233 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:26:37.235 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29058), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [33ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [39ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [43ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [43ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [90ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [100ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [101ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [145ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [147ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [147ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [183ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [184ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [184ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [342ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [342ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [443ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [443ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1382ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2922ms] too many traces: truncated at 100 traces, deferred=Deferred@1575727358(state=PENDING, result=null, callback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497), errback=(continuation of Deferred@1389881197 after retry RPC after error@814124250) -> (continuation of Deferred@1607372731 after retry RPC after error@1604495612) -> (continuation of Deferred@841203946 after retry RPC after error@910653992) -> (continuation of Deferred@501188620 after retry RPC after error@1466971651) -> (continuation of Deferred@2071500951 after retry RPC after error@1986210794) -> (continuation of Deferred@396186306 after retry RPC after error@1091288604) -> (continuation of Deferred@2122853002 after retry RPC after error@299590346) -> (continuation of Deferred@1814899057 after retry RPC after error@1892323766) -> (continuation of Deferred@1328097631 after retry RPC after error@86953794) -> (continuation of Deferred@13436983 after retry RPC after error@607026873) -> (continuation of Deferred@583780530 after retry RPC after error@1374443382) -> (continuation of Deferred@965243340 after retry RPC after error@1845763058) -> (continuation of Deferred@309772504 after retry RPC after error@563241479) -> (continuation of Deferred@1542353384 after retry RPC after error@360393452) -> (continuation of Deferred@825186459 after retry RPC after error@52397795) -> (continuation of Deferred@727107161 after retry RPC after error@1740027285) -> (continuation of Deferred@739693176 after retry RPC after error@1396793735) -> (continuation of Deferred@1312293304 after retry RPC after error@485494775) -> (continuation of Deferred@116361987 after retry RPC after error@1593483008) -> (continuation of Deferred@1346461862 after retry RPC after error@1288848110) -> (continuation of Deferred@908034020 after retry RPC after error@1016591544) -> (continuation of Deferred@1728636892 after retry RPC after error@965938401) -> (continuation of Deferred@1950262376 after retry RPC after error@2005908579) -> (continuation of Deferred@1461289801 after retry RPC after error@1993107791) -> (continuation of Deferred@2010156570 after retry RPC after error@2109102119) -> (continuation of Deferred@1722715923 after retry RPC after error@1941767320) -> (continuation of Deferred@7271595 after retry RPC after error@1331094497)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:37.237 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:37.238 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
14:26:37.239 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
14:26:37.257 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:37.257 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:37.257 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:37.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:37.258 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.258 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.258 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:37.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:37.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:37.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.298578 22775 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:37.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.299193 22775 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:37.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.299916 22775 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:37.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.355489 22775 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.356734 22775 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.234.1
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.416147 22775 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:37.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.1:0
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data/info.pb
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.1
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.1
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/logs
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:37.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:37.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.417793 22775 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:37.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.419741 22775 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:37.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.445555 22801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:37.454 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:37.455 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:37.455 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:37.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.457 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:37.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:37.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:37.482 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:37.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.483 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:37.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:37.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:37.483 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:37.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.577724 22768 catalog_manager.cc:1295] Loaded cluster ID: ec5f41016bf14af4851f01a4eb03cec1
14:26:37.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.578153 22768 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: loading cluster ID for follower catalog manager: success
14:26:37.579 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:37.579 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:37.580 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:37.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.580 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.584352 22768 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: acquiring CA information for follower catalog manager: success
14:26:37.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:37.596649 22768 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 4da7eae8e7ef43ae8d904db0d9b0c474: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:37.647 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:37.647 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:37.647 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:37.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:37.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:37.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:37.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:37.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:37.649 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:37.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:37.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:37.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:37.649 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:37.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114397658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:37.671 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:26:37.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
14:26:37.673 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.699 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:37.699 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:37.699 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:37.699 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.699 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.699 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:37.700 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.700 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:37.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.700 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:37.700 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:37.713 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:37.714 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:37.714 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.714 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.714 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.714 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.714 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:37.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.715 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:37.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:37.911 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:37.912 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:37.912 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:37.912 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.912 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.912 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.912 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.912 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.913 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.913 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.913 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.913 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:37.915 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29698), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [10ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [10ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [38ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [66ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [169ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [170ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [172ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [201ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [240ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [341ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [341ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [519ms] refreshing cache from master, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [521ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [521ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1939ms] refreshing cache from master, [1939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1940ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1941ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [5160ms] too many traces: truncated at 100 traces, deferred=Deferred@1361386789(state=PENDING, result=null, callback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765), errback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765)))
14:26:37.916 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:37.916 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:37.916 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:37.917 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29698), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [10ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [10ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [38ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [66ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [169ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [170ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [172ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [201ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [240ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [341ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [341ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [519ms] refreshing cache from master, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [521ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [521ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1939ms] refreshing cache from master, [1939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1940ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1941ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [5160ms] too many traces: truncated at 100 traces, deferred=Deferred@1361386789(state=PENDING, result=null, callback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765), errback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29698), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [10ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [10ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [38ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [66ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [169ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [170ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [172ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [201ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [240ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [341ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [341ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [519ms] refreshing cache from master, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [521ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [521ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1939ms] refreshing cache from master, [1939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1940ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1941ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [5160ms] too many traces: truncated at 100 traces, deferred=Deferred@1361386789(state=PENDING, result=null, callback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765), errback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:37.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.919 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.919 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.919 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.920 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:37.931 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:37.931 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:37.931 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:37.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.932 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.932 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.932 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.932 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:37.932 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:37.933 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:37.933 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:37.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.933 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:37.933 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.933 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:37.934 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.934 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.934 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:37.934 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:37.930 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29698), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [10ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [10ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [38ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [66ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [169ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [170ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [172ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [201ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [240ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [341ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [341ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [519ms] refreshing cache from master, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [521ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [521ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1939ms] refreshing cache from master, [1939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1940ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1941ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [5160ms] too many traces: truncated at 100 traces, deferred=Deferred@1361386789(state=PENDING, result=null, callback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765), errback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29698), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [10ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [10ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [38ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [66ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [120ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [168ms] refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [169ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [170ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [172ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [200ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [201ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [201ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [240ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [240ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [340ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [341ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [341ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [519ms] refreshing cache from master, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [519ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [520ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [521ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [521ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1939ms] refreshing cache from master, [1939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1940ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1941ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [5160ms] too many traces: truncated at 100 traces, deferred=Deferred@1361386789(state=PENDING, result=null, callback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765), errback=(continuation of Deferred@836106554 after retry RPC after error@1106396226) -> (continuation of Deferred@1971526782 after retry RPC after error@204930014) -> (continuation of Deferred@305454923 after retry RPC after error@1094142235) -> (continuation of Deferred@750439855 after retry RPC after error@392772589) -> (continuation of Deferred@596861132 after retry RPC after error@1477941812) -> (continuation of Deferred@582677292 after retry RPC after error@2094142149) -> (continuation of Deferred@1149212819 after retry RPC after error@542997522) -> (continuation of Deferred@1435224230 after retry RPC after error@967027944) -> (continuation of Deferred@18874447 after retry RPC after error@1247166869) -> (continuation of Deferred@1091796609 after retry RPC after error@1702055591) -> (continuation of Deferred@1691359294 after retry RPC after error@477280216) -> (continuation of Deferred@1187980705 after retry RPC after error@959864233) -> (continuation of Deferred@1564717913 after retry RPC after error@1409684318) -> (continuation of Deferred@1809569362 after retry RPC after error@1611339157) -> (continuation of Deferred@538098614 after retry RPC after error@1156239369) -> (continuation of Deferred@1899423616 after retry RPC after error@1235874702) -> (continuation of Deferred@2085830150 after retry RPC after error@1856750365) -> (continuation of Deferred@677852079 after retry RPC after error@777289902) -> (continuation of Deferred@1259481196 after retry RPC after error@2064755000) -> (continuation of Deferred@1794774974 after retry RPC after error@1612823487) -> (continuation of Deferred@975879839 after retry RPC after error@1283758219) -> (continuation of Deferred@1987653954 after retry RPC after error@459837553) -> (continuation of Deferred@1951992773 after retry RPC after error@477205765)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:37.938 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:37.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
14:26:37.942 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
14:26:37.943 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:26:37.944 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
14:26:37.944 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:26:37.952 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:37.952 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:37.952 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:37.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.952 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.953 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.953 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
14:26:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
14:26:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
14:26:37.970 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
14:26:37.971 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
14:26:37.972 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 01c353b3dfaac48d363fa91db2a11301
14:26:37.972 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:37.972 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:37.972 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:37.973 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.973 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.973 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:37.973 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.973 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.973 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:37.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:37.974 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:37.975 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RESTARTING to RUNNING.
14:26:37.975 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 01c353b3dfaac48d363fa91db2a11301 from Checkpoint 66 @ 1779114366685 for 01c353b3dfaac48d363fa91db2a11301 located at file:/tmp/junit12845694439211909930/checkpoints/01c353b3dfaac48d363fa91db2a11301/chk-66.
14:26:37.976 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:26:37.977 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:37.987 [INFO - Thread-67] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:37.987 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
14:26:37.988 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.17.128.60:42293(127.17.128.60:42293)] disconnecting while in state TERMINATED
14:26:37.988 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.17.128.61:34199(127.17.128.61:34199)] disconnecting while in state TERMINATED
14:26:37.988 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.17.128.62:37019(127.17.128.62:37019)] disconnecting while in state TERMINATED
14:26:37.988 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
14:26:37.989 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 7e4df4c5072cc4cbd3d010fcf80896db
14:26:37.989 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
14:26:37.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
14:26:37.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id f637657deada1029ec0e73b52fd27482
14:26:37.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
14:26:37.991 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
14:26:37.991 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 6295e036bf819b517a25e7bc93bbccc6
14:26:37.991 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:37.992 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 7e4df4c5072cc4cbd3d010fcf80896db.
14:26:37.993 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 7e4df4c5072cc4cbd3d010fcf80896db.
14:26:37.993 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:37.994 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:37.994 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:37.996 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
14:26:37.996 [INFO - Thread-67] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:37.996 [INFO - Thread-67] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:37.996 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:37.997 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
14:26:37.997 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 502ab7224a4d234d987b3014c28d82e3
14:26:37.998 [DEBUG - Thread-67] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:37.999 [INFO - Thread-67] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:38.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.003 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f637657deada1029ec0e73b52fd27482.
14:26:38.004 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
14:26:38.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
14:26:38.005 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id f637657deada1029ec0e73b52fd27482.
14:26:38.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1297cd05
14:26:38.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:38.014 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:38.014 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:26:38.014 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
14:26:38.028 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:38.028 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:38.028 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:38.028 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:38.030 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a0a2e92
14:26:38.046 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 6295e036bf819b517a25e7bc93bbccc6.
14:26:38.048 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 6295e036bf819b517a25e7bc93bbccc6.
14:26:38.048 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
14:26:38.048 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
14:26:38.052 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29abba7c
14:26:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:26:38.057 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
14:26:38.070 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 502ab7224a4d234d987b3014c28d82e3.
14:26:38.071 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
14:26:38.071 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
14:26:38.072 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 502ab7224a4d234d987b3014c28d82e3.
14:26:38.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4b359694
14:26:38.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:38.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:38.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:26:38.073 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
14:26:38.075 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@59e9de6d
14:26:38.079 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@289d9ba9
14:26:38.082 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:38.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.106 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.107 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.107 [DEBUG - pool-375-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.110 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.112 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29935), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [64ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [70ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [75ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [75ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [105ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [110ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [119ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [119ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [143ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [143ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [143ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [161ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [180ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [181ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [182ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [182ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [221ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [314ms] refreshing cache from master, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [315ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [317ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [317ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [317ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [380ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [381ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [381ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [381ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [541ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [541ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [542ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [940ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [940ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [940ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [941ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1902ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2562ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3680ms] refreshing cache from master, [3680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3681ms] too many traces: truncated at 100 traces, deferred=Deferred@114355012(state=PENDING, result=null, callback=(continuation of Deferred@395530758 after retry RPC after error@713204742) -> (continuation of Deferred@451279541 after retry RPC after error@468625510) -> (continuation of Deferred@375442047 after retry RPC after error@704507425) -> (continuation of Deferred@477665785 after retry RPC after error@1924902792) -> (continuation of Deferred@1645781138 after retry RPC after error@617797142) -> (continuation of Deferred@2092770340 after retry RPC after error@1406469076) -> (continuation of Deferred@1961768204 after retry RPC after error@1186869217) -> (continuation of Deferred@1404546838 after retry RPC after error@671599895) -> (continuation of Deferred@767875918 after retry RPC after error@439494704) -> (continuation of Deferred@1947462527 after retry RPC after error@1651179423) -> (continuation of Deferred@1778337335 after retry RPC after error@1653047440) -> (continuation of Deferred@153405356 after retry RPC after error@1015502608) -> (continuation of Deferred@794452041 after retry RPC after error@1896343090) -> (continuation of Deferred@1580287513 after retry RPC after error@1476965656) -> (continuation of Deferred@615308920 after retry RPC after error@1783929513) -> (continuation of Deferred@1040255092 after retry RPC after error@591186649) -> (continuation of Deferred@1629589464 after retry RPC after error@804180103) -> (continuation of Deferred@421150630 after retry RPC after error@1555383390) -> (continuation of Deferred@830955359 after retry RPC after error@1756683008) -> (continuation of Deferred@538656447 after retry RPC after error@1450842454) -> (continuation of Deferred@1561123169 after retry RPC after error@330200347) -> (continuation of Deferred@1790533399 after retry RPC after error@1812945855) -> (continuation of Deferred@1467175054 after retry RPC after error@924185046) -> (continuation of Deferred@393499076 after retry RPC after error@19931702), errback=(continuation of Deferred@395530758 after retry RPC after error@713204742) -> (continuation of Deferred@451279541 after retry RPC after error@468625510) -> (continuation of Deferred@375442047 after retry RPC after error@704507425) -> (continuation of Deferred@477665785 after retry RPC after error@1924902792) -> (continuation of Deferred@1645781138 after retry RPC after error@617797142) -> (continuation of Deferred@2092770340 after retry RPC after error@1406469076) -> (continuation of Deferred@1961768204 after retry RPC after error@1186869217) -> (continuation of Deferred@1404546838 after retry RPC after error@671599895) -> (continuation of Deferred@767875918 after retry RPC after error@439494704) -> (continuation of Deferred@1947462527 after retry RPC after error@1651179423) -> (continuation of Deferred@1778337335 after retry RPC after error@1653047440) -> (continuation of Deferred@153405356 after retry RPC after error@1015502608) -> (continuation of Deferred@794452041 after retry RPC after error@1896343090) -> (continuation of Deferred@1580287513 after retry RPC after error@1476965656) -> (continuation of Deferred@615308920 after retry RPC after error@1783929513) -> (continuation of Deferred@1040255092 after retry RPC after error@591186649) -> (continuation of Deferred@1629589464 after retry RPC after error@804180103) -> (continuation of Deferred@421150630 after retry RPC after error@1555383390) -> (continuation of Deferred@830955359 after retry RPC after error@1756683008) -> (continuation of Deferred@538656447 after retry RPC after error@1450842454) -> (continuation of Deferred@1561123169 after retry RPC after error@330200347) -> (continuation of Deferred@1790533399 after retry RPC after error@1812945855) -> (continuation of Deferred@1467175054 after retry RPC after error@924185046) -> (continuation of Deferred@393499076 after retry RPC after error@19931702)))
14:26:38.114 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.122 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:38.132 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.146 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
14:26:38.146 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
14:26:38.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a2dad5
14:26:38.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:38.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:26:38.148 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:26:38.148 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
14:26:38.153 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.153 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.154 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.154 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114398158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:38.162 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.163 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.166 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.167 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.167 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.167 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.167 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.167 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.168 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:26:38.169 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
14:26:38.170 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@120d3130
14:26:38.173 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:38.173 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.174 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.174 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:38.175 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:38.175 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:38.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.176 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.177 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:38.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.178 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.178 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.178 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.179 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:38.179 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:38.179 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:38.180 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.180 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.180 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.181 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.181 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:38.194 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.196 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:38.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:38.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:38.198 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.198 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.198 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.199 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.199 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.199 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.199 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:38.200 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.208 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.213 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.218 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.226 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.230 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.231 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.232 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.234 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.238 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.238 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.238 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.242 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.274 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.275 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.276 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.277 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.287 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.287 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.288 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.302 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.303 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.303 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.303 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.303 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.311 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.312 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.312 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.313 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.313 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.314 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.326 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.326 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.326 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.327 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.327 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.327 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.329 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.342 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.342 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.343 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.343 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.344 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.344 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.350 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.350 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.350 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.354 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.354 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.355 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.355 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.355 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.355 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.355 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.355 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.356 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.356 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.366 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.366 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.366 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.366 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.367 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.367 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.367 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.367 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.368 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.374 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.374 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.374 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.374 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.375 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.375 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.375 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.376 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.376 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.376 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.377 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.378 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.378 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.378 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.378 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.382 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.383 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.387 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.387 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.387 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.387 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.387 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.387 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.388 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.388 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.388 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.388 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.388 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.389 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.389 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.389 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.389 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.394 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.394 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.394 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.394 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.402 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.402 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.402 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.402 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.402 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.402 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.403 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.403 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.407 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.412 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.414 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.414 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.414 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.414 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.414 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.414 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.414 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.415 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.415 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.416 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.416 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.423 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.423 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.423 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.423 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.423 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.423 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.424 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.424 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.424 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.424 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.424 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.426 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.426 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.427 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.427 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.427 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.427 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.427 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.428 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:38.429 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:38.429 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:38.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.430 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.430 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.430 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.430 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.430 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:38.430 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.430 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.430 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.431 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.431 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.431 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.431 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.431 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26689), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [30ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [52ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [52ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [64ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [983ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1942ms] refreshing cache from master, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1944ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3881ms] refreshing cache from master, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3881ms] too many traces: truncated at 100 traces, deferred=Deferred@776048591(state=PENDING, result=null, callback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469), errback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469)))
14:26:38.432 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:26:38.432 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.433 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.433 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.432 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26689), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [30ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [52ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [52ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [64ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [983ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1942ms] refreshing cache from master, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1944ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3881ms] refreshing cache from master, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3881ms] too many traces: truncated at 100 traces, deferred=Deferred@776048591(state=PENDING, result=null, callback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469), errback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:38.433 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.433 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
14:26:38.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.433 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.433 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.433 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.434 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.434 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.434 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.434 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.434 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.434 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.434 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.435 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.435 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.435 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.435 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.436 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.437 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.437 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.438 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
14:26:38.443 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26689), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [20ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [30ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [43ms] refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [52ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [52ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [64ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [64ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [982ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [983ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [983ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1942ms] refreshing cache from master, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1944ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3881ms] refreshing cache from master, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3881ms] too many traces: truncated at 100 traces, deferred=Deferred@776048591(state=PENDING, result=null, callback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469), errback=(continuation of Deferred@1850094385 after retry RPC after error@475699079) -> (continuation of Deferred@2039473615 after retry RPC after error@1536307910) -> (continuation of Deferred@76696894 after retry RPC after error@1287390340) -> (continuation of Deferred@1251680577 after retry RPC after error@13971158) -> (continuation of Deferred@381184079 after retry RPC after error@973915704) -> (continuation of Deferred@688810257 after retry RPC after error@283000) -> (continuation of Deferred@1437313831 after retry RPC after error@155880108) -> (continuation of Deferred@1398156405 after retry RPC after error@1903900918) -> (continuation of Deferred@2030126957 after retry RPC after error@608419083) -> (continuation of Deferred@1184106610 after retry RPC after error@1845503198) -> (continuation of Deferred@491334748 after retry RPC after error@618361115) -> (continuation of Deferred@1114253930 after retry RPC after error@765706285) -> (continuation of Deferred@2036081161 after retry RPC after error@108054416) -> (continuation of Deferred@366646350 after retry RPC after error@642489456) -> (continuation of Deferred@1042267866 after retry RPC after error@1045672654) -> (continuation of Deferred@2146052526 after retry RPC after error@87589439) -> (continuation of Deferred@1175590188 after retry RPC after error@1702107874) -> (continuation of Deferred@1266546875 after retry RPC after error@169190033) -> (continuation of Deferred@1551396234 after retry RPC after error@429842413) -> (continuation of Deferred@1031951429 after retry RPC after error@438597710) -> (continuation of Deferred@86983357 after retry RPC after error@1780581442) -> (continuation of Deferred@1160693055 after retry RPC after error@2087793628) -> (continuation of Deferred@62172229 after retry RPC after error@1699818469)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:38.449 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
14:26:38.449 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:26:38.450 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:38.450 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
14:26:38.452 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.452 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.452 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.453 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.453 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.453 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.453 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.453 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.453 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.453 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.453 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.453 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.462 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.462 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.462 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.463 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.463 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.463 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.464 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.467 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.467 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.467 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.468 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.474 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.474 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.474 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.475 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.480 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:38.481 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:38.481 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:38.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.482 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:38.483 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.483 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.483 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.484 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.493 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.493 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.493 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.493 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.493 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.493 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.493 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.493 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.493 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.493 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.507 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.507 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.507 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.508 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.508 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.508 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.512 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.512 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.512 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.513 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.513 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.513 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.513 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.513 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.513 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.513 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.513 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.513 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.513 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.514 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.514 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.514 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:38.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:38.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:38.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:38.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:38.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:38.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:38.522 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.522 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.523 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.523 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.523 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.523 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.523 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.523 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.523 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.524 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.526 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.526 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.526 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.527 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.527 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.527 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.528 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.534 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.534 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.534 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.535 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.535 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.536 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.592 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.592 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.592 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.593 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.593 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.593 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.593 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.594 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.594 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.594 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.594 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.594 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.594 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.594 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.595 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.595 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.595 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.595 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.615 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:38.615 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:38.615 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:38.616 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.616 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.616 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:38.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:38.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:38.617 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:38.632 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:38.632 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:38.632 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:38.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.632 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:38.633 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.633 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.633 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:38.633 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.633 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.633 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:38.633 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:38.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:38.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:38.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:38.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:38.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114398658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:38.666 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:26:38.667 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
14:26:38.682 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.683 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.683 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.684 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.684 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.684 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.684 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.694 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.694 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.694 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.694 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.694 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.694 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.695 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.756 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.787 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:38.787 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:38.787 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:38.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:38.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:38.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:38.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:38.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:38.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:38.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:38.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:38.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:38.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:38.794 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:38.794 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:38.794 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:38.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:38.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:38.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:38.795 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:38.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:38.954 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:38.955 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:38.955 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:38.955 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.955 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:38.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:38.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:38.955 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:38.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.047 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.047 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.048 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.049 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.049 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.049 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.049 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.072 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:39.072 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:39.072 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:39.073 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.073 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.073 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.073 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.074 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:39.074 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.074 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.074 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.075 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.087 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.087 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.087 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.088 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.088 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.152 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:39.152 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:39.152 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:39.153 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.153 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.153 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:39.153 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.153 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.153 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:39.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.154 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.154 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:39.154 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:39.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114399158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:39.166 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:39.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
14:26:39.182 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.182 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.182 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.184 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.189 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:39.189 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:39.189 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:39.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:39.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:39.189 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:39.190 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:39.190 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:39.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:39.190 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:39.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:39.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:39.190 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:39.203 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.203 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.203 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.203 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.203 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.203 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.203 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.204 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.204 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.204 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.279 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:39.279 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:39.279 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:39.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:39.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:39.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:39.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:39.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:39.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:39.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:39.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:39.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:39.280 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:39.282 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:39.282 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:39.282 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:39.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:39.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:39.283 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:39.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:39.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:39.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:39.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:39.283 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:39.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:39.283 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:39.284 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27421), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [14ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [21ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [22ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [140ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [261ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [262ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1062ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1683ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3940ms] refreshing cache from master, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3941ms] too many traces: truncated at 100 traces, deferred=Deferred@1286763998(state=PENDING, result=null, callback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526), errback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526)))
14:26:39.285 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:26:39.285 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27421), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [14ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [21ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [22ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [140ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [261ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [262ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1062ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1683ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3940ms] refreshing cache from master, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3941ms] too many traces: truncated at 100 traces, deferred=Deferred@1286763998(state=PENDING, result=null, callback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526), errback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:39.286 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
14:26:39.287 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
14:26:39.289 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27421), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [12ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [14ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [21ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [22ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [22ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [85ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [140ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [261ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [262ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [262ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [321ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1062ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1683ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3940ms] refreshing cache from master, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3941ms] too many traces: truncated at 100 traces, deferred=Deferred@1286763998(state=PENDING, result=null, callback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526), errback=(continuation of Deferred@928579329 after retry RPC after error@1553440796) -> (continuation of Deferred@804341664 after retry RPC after error@1882381061) -> (continuation of Deferred@6460149 after retry RPC after error@1628718501) -> (continuation of Deferred@1149096544 after retry RPC after error@586269465) -> (continuation of Deferred@907020424 after retry RPC after error@1969904258) -> (continuation of Deferred@1596876957 after retry RPC after error@1936429418) -> (continuation of Deferred@1166640071 after retry RPC after error@1645244350) -> (continuation of Deferred@1322686945 after retry RPC after error@1629073808) -> (continuation of Deferred@1745326543 after retry RPC after error@151748334) -> (continuation of Deferred@1944643519 after retry RPC after error@1607552355) -> (continuation of Deferred@193738431 after retry RPC after error@1503839534) -> (continuation of Deferred@1833112762 after retry RPC after error@950855204) -> (continuation of Deferred@1392444992 after retry RPC after error@498803332) -> (continuation of Deferred@1755841357 after retry RPC after error@938100154) -> (continuation of Deferred@487426049 after retry RPC after error@1499866662) -> (continuation of Deferred@1904010284 after retry RPC after error@350140460) -> (continuation of Deferred@1709340470 after retry RPC after error@224213690) -> (continuation of Deferred@462877369 after retry RPC after error@2053649983) -> (continuation of Deferred@205895043 after retry RPC after error@1755956827) -> (continuation of Deferred@1141301965 after retry RPC after error@2137324988) -> (continuation of Deferred@1579984510 after retry RPC after error@2014390526)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.60:39347
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:39.290 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
14:26:39.291 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
14:26:39.291 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:39.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:38.841976 22799 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 22775
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:39.493549 22799 kernel_stack_watchdog.cc:198] Thread 22775 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 386ms:
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:26:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:26:39.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:39.495505 22775 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.044s	user 0.640s	sys 1.022s
14:26:39.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:39.495728 22804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:39.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:39.495878 22775 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.045s	user 0.640s	sys 1.022s
14:26:39.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.496155 22775 server_base.cc:1061] running on GCE node
14:26:39.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:37.454402 22800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:39.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.500960 22775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.512326 22775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:39.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.513800 22775 hybrid_clock.cc:648] HybridClock initialized: now 1779114399513716 us; error 56 us; skew 500 ppm
14:26:39.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.515776 22775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:39.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.548766 22775 webserver.cc:533] Webserver started at http://127.21.234.1:39367/ using document root <none> and password file <none>
14:26:39.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.550331 22775 fs_manager.cc:362] Metadata directory not provided
14:26:39.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.550626 22775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:39.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.551107 22775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:39.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.559204 22775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data/instance:
14:26:39.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8e733c2e2b4440b94f05b991bb5407f"
14:26:39.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:39 on dist-test-slave-1n46"
14:26:39.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.561048 22775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal/instance:
14:26:39.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8e733c2e2b4440b94f05b991bb5407f"
14:26:39.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:39 on dist-test-slave-1n46"
14:26:39.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.583478 22775 fs_manager.cc:696] Time spent creating directory manager: real 0.022s	user 0.011s	sys 0.003s
14:26:39.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.594 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.594 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.594 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.594 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.594 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.595 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.595 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.595 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.595 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.602134 22868 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:39.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.611358 22775 fs_manager.cc:730] Time spent opening block manager: real 0.021s	user 0.004s	sys 0.005s
14:26:39.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.611883 22775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal
14:26:39.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8e733c2e2b4440b94f05b991bb5407f"
14:26:39.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:39 on dist-test-slave-1n46"
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.612466 22775 fs_report.cc:389] FS layout report
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data/data
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:39.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:39.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114399658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:39.667 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:39.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
14:26:39.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.731841 22775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:39.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.734476 22775 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:39.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.735424 22775 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:39.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.752004 22775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:39.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.771879 22775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:39.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.772377 22775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
14:26:39.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.772840 22775 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:39.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:39.773245 22775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:39.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:39.835 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.835 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.835 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.835 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.835 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.835 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.836 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.836 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.836 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:39.942 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:39.943 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:39.943 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:39.943 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.943 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.943 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:39.943 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.944 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.944 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:39.944 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.944 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.944 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:39.944 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:40.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.021 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:40.021 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:40.021 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:40.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.021 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.022 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:40.040 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:40.041 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:40.041 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:40.041 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.041 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.041 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.041 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.041 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.042 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:40.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.148 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:40.148 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:40.148 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:40.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.149 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:40.158 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:40.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:40.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:40.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114400158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:40.159 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.159 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:40.167 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:40.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
14:26:40.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.214210 22775 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.1:36065
14:26:40.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.214504 22981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.1:36065 every 8 connection(s)
14:26:40.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.218200 22775 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/data/info.pb
14:26:40.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.221298 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 22775
14:26:40.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.222018 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-0/wal/instance
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.251031 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/logs
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data/info.pb
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:40.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.2:0
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.2
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.2
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:40.275 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:40.275 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:40.275 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:40.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.276 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.276 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.276 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.276 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.276 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.276 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.276 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.303273 22983 heartbeater.cc:344] Connected to a master server at 127.21.234.60:44393
14:26:40.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.303785 22983 heartbeater.cc:461] Registering TS with master...
14:26:40.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.305111 22983 heartbeater.cc:507] Master 127.21.234.60:44393 requested a full tablet report, sending...
14:26:40.306 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:40.306 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:40.307 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:40.307 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.307 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.307 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.308 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:40.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.307828 22982 heartbeater.cc:344] Connected to a master server at 127.21.234.61:40633
14:26:40.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.308157 22982 heartbeater.cc:461] Registering TS with master...
14:26:40.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.308447 22694 ts_manager.cc:194] Registered new tserver with Master: e8e733c2e2b4440b94f05b991bb5407f (127.21.234.1:36065)
14:26:40.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.309031 22982 heartbeater.cc:507] Master 127.21.234.61:40633 requested a full tablet report, sending...
14:26:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.310941 22694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.234.1:35939
14:26:40.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.312011 22614 ts_manager.cc:194] Registered new tserver with Master: e8e733c2e2b4440b94f05b991bb5407f (127.21.234.1:36065)
14:26:40.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.343 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:40.343 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:40.343 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:40.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:40.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.344 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.344 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:40.344 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:40.345 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:40.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.351583 22988 heartbeater.cc:344] Connected to a master server at 127.21.234.62:34045
14:26:40.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.352006 22988 heartbeater.cc:461] Registering TS with master...
14:26:40.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.352849 22988 heartbeater.cc:507] Master 127.21.234.62:34045 requested a full tablet report, sending...
14:26:40.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.357290 22485 ts_manager.cc:194] Registered new tserver with Master: e8e733c2e2b4440b94f05b991bb5407f (127.21.234.1:36065)
14:26:40.358 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:40.359 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:40.359 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:40.359 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.359 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.359 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.360 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.360 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.360 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.360 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:40.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:40.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:40.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:40.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:40.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:40.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:40.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:40.369 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:40.369 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:40.369 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:40.369 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:40.369 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:40.369 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:40.408 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:40.408 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:40.408 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:40.409 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.409 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:40.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:40.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:40.410 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:40.432 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:40.432 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:40.432 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:40.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:40.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:40.433 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:40.433 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:40.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:40.433 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:40.433 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:40.433 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:40.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:40.433 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:40.480 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:40.480 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:40.480 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:40.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.481 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.482 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:40.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.634 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:40.635 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:40.635 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:40.635 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:40.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:40.635 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:40.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:40.636 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:40.636 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:40.636 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:40.636 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:40.636 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:40.636 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:40.637 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [8ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [9ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [90ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [91ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [144ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] refreshing cache from master, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [325ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [325ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1343ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2887ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6902ms] refreshing cache from master, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6903ms] too many traces: truncated at 100 traces, deferred=Deferred@392946483(state=PENDING, result=null, callback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946), errback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946)))
14:26:40.638 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:26:40.638 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [8ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [9ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [90ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [91ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [144ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] refreshing cache from master, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [325ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [325ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1343ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2887ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6902ms] refreshing cache from master, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6903ms] too many traces: truncated at 100 traces, deferred=Deferred@392946483(state=PENDING, result=null, callback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946), errback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:40.639 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
14:26:40.642 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
14:26:40.644 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [8ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [9ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [25ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [34ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [34ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [77ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [90ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [91ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [91ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [144ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [283ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [283ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [323ms] refreshing cache from master, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [324ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [325ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [325ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [762ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [762ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1343ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2887ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6902ms] refreshing cache from master, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6903ms] too many traces: truncated at 100 traces, deferred=Deferred@392946483(state=PENDING, result=null, callback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946), errback=(continuation of Deferred@171247127 after retry RPC after error@251364212) -> (continuation of Deferred@481357606 after retry RPC after error@1410004472) -> (continuation of Deferred@1991066832 after retry RPC after error@614439250) -> (continuation of Deferred@1062046520 after retry RPC after error@1022041116) -> (continuation of Deferred@553407637 after retry RPC after error@2020678865) -> (continuation of Deferred@724978860 after retry RPC after error@1331281450) -> (continuation of Deferred@222499752 after retry RPC after error@2099515717) -> (continuation of Deferred@1693348193 after retry RPC after error@1724136248) -> (continuation of Deferred@1930406427 after retry RPC after error@779887366) -> (continuation of Deferred@957233873 after retry RPC after error@2127878963) -> (continuation of Deferred@1879435648 after retry RPC after error@1068404885) -> (continuation of Deferred@2000612611 after retry RPC after error@795590036) -> (continuation of Deferred@1887242256 after retry RPC after error@1000080562) -> (continuation of Deferred@1003135031 after retry RPC after error@1237269959) -> (continuation of Deferred@1369084264 after retry RPC after error@184067709) -> (continuation of Deferred@1683846157 after retry RPC after error@1413229636) -> (continuation of Deferred@1361634938 after retry RPC after error@506227052) -> (continuation of Deferred@291412920 after retry RPC after error@615893979) -> (continuation of Deferred@850981377 after retry RPC after error@1327663667) -> (continuation of Deferred@709122868 after retry RPC after error@547731124) -> (continuation of Deferred@1442345051 after retry RPC after error@248515525) -> (continuation of Deferred@113605840 after retry RPC after error@190347946)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:40.645 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:40.647 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
14:26:40.647 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
14:26:40.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114400658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:40.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:26:40.674 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
14:26:40.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.759634 22993 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:40.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.760275 22993 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:40.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.760892 22993 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:40.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.799789 22993 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:40.802 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:40.802 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:40.802 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:40.802 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.802 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.802 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.802 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:40.802 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.802 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:40.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.803 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:40.803 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:40.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.800983 22993 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.234.2
14:26:40.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.844990 22993 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.2:0
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data/info.pb
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.2
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.2
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/logs
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:40.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.846706 22993 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:40.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:40.848557 22993 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:40.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.866256 22999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:40.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:40.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:40.897 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:40.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:40.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:40.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:40.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:40.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:40.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:40.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:40.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:40.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:40.899 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:40.915 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:40.915 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:40.915 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:40.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:40.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.916 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:40.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:40.916 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:41.003 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.099 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:41.099 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:41.099 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:41.100 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.100 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.101 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.101 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.101 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.101 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:41.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114401159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:41.171 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:26:41.174 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
14:26:41.187 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:41.187 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:41.187 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:41.187 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.187 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.187 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:41.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.187 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:41.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:41.188 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:41.213 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:41.213 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:41.213 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:41.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:41.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:41.214 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:41.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:41.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:41.214 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:41.214 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:41.214 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:41.214 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:41.214 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:41.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:41.314718 22983 heartbeater.cc:499] Master 127.21.234.60:44393 was elected leader, sending a full tablet report...
14:26:41.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.434 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:41.435 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:41.435 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:41.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:41.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:41.435 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:41.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:41.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:41.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:41.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:41.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:41.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:41.436 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:41.437 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29691), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [51ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [76ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [87ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [87ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [116ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [127ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [423ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [803ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2022ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2461ms] too many traces: truncated at 100 traces, deferred=Deferred@985050329(state=PENDING, result=null, callback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796), errback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796)))
14:26:41.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
14:26:41.438 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29691), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [51ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [76ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [87ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [87ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [116ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [127ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [423ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [803ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2022ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2461ms] too many traces: truncated at 100 traces, deferred=Deferred@985050329(state=PENDING, result=null, callback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796), errback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:41.439 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
14:26:41.479 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
14:26:41.483 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29691), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [50ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [51ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [76ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [76ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [84ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [85ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [87ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [87ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [116ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [127ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [141ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [141ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [182ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [422ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [423ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [803ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1161ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2022ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [2461ms] too many traces: truncated at 100 traces, deferred=Deferred@985050329(state=PENDING, result=null, callback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796), errback=(continuation of Deferred@1049704366 after retry RPC after error@1111428250) -> (continuation of Deferred@167971165 after retry RPC after error@89959584) -> (continuation of Deferred@851953634 after retry RPC after error@136730364) -> (continuation of Deferred@452853572 after retry RPC after error@2049210647) -> (continuation of Deferred@1984977254 after retry RPC after error@1291542758) -> (continuation of Deferred@965321186 after retry RPC after error@1614584581) -> (continuation of Deferred@349402381 after retry RPC after error@54053665) -> (continuation of Deferred@2001398805 after retry RPC after error@1940567370) -> (continuation of Deferred@2094980399 after retry RPC after error@972714070) -> (continuation of Deferred@435165496 after retry RPC after error@1071054761) -> (continuation of Deferred@896232153 after retry RPC after error@1610204386) -> (continuation of Deferred@1180250108 after retry RPC after error@1325050665) -> (continuation of Deferred@539573645 after retry RPC after error@828777406) -> (continuation of Deferred@1045417121 after retry RPC after error@628591522) -> (continuation of Deferred@1281036244 after retry RPC after error@1277210162) -> (continuation of Deferred@206195155 after retry RPC after error@360315235) -> (continuation of Deferred@29913527 after retry RPC after error@1221594754) -> (continuation of Deferred@378192538 after retry RPC after error@1289913289) -> (continuation of Deferred@241501739 after retry RPC after error@1183427963) -> (continuation of Deferred@114768162 after retry RPC after error@1584598778) -> (continuation of Deferred@2021723969 after retry RPC after error@1944618847) -> (continuation of Deferred@1279901225 after retry RPC after error@176913796)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:41.485 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
14:26:41.486 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
14:26:41.486 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 77d052e6e51b5ae35525074f80512696
14:26:41.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.516 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:41.516 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:41.517 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:41.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.518 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:41.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:41.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:41.567 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:41.567 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.567 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.567 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.567 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.567 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.567 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.567 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:41.569 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:41.569 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:41.569 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:41.569 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:41.569 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:41.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:41.569 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:41.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:41.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:41.570 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:41.570 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:41.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:41.570 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:41.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.594 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:41.594 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:41.595 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:41.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.595 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.595 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.595 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.595 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.595 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:41.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.606 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:41.607 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:41.607 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:41.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:41.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:41.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:41.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:41.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114401658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:41.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:41.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
14:26:41.722 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:41.722 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:41.722 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:41.722 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:41.723 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.723 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.723 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:41.723 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.723 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.723 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:41.723 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:41.737 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.737 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.737 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.738 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.739 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.739 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.740 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29856), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [7ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [78ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [120ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [682ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1982ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2002ms] too many traces: truncated at 100 traces, deferred=Deferred@351922842(state=PENDING, result=null, callback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566), errback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566)))
14:26:41.741 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.742 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.742 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.743 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.741 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29856), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [7ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [78ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [120ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [682ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1982ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2002ms] too many traces: truncated at 100 traces, deferred=Deferred@351922842(state=PENDING, result=null, callback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566), errback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29856), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [7ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [78ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [120ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [682ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1982ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2002ms] too many traces: truncated at 100 traces, deferred=Deferred@351922842(state=PENDING, result=null, callback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566), errback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.124:35565
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:41.750 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29856), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [7ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [78ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [120ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [682ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1982ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2002ms] too many traces: truncated at 100 traces, deferred=Deferred@351922842(state=PENDING, result=null, callback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566), errback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29856), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [6ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [7ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [78ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [120ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [141ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [164ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [164ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [682ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [682ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1202ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.124:35565: Network error: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.125:45957: Network error: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957, [1981ms] Sub RPC ConnectToMaster: received response from server master-127.13.91.126:39961: Network error: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [1982ms] delaying RPC due to: Service unavailable: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.124:35565, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.126:39961, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.91.125:45957, [2002ms] too many traces: truncated at 100 traces, deferred=Deferred@351922842(state=PENDING, result=null, callback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566), errback=(continuation of Deferred@1464137994 after retry RPC after error@1174976772) -> (continuation of Deferred@1213946842 after retry RPC after error@330155377) -> (continuation of Deferred@1666310823 after retry RPC after error@1611839312) -> (continuation of Deferred@1912972547 after retry RPC after error@268329087) -> (continuation of Deferred@1666646013 after retry RPC after error@378240240) -> (continuation of Deferred@1241120415 after retry RPC after error@905478727) -> (continuation of Deferred@1627732498 after retry RPC after error@748987966) -> (continuation of Deferred@716159027 after retry RPC after error@1538588059) -> (continuation of Deferred@321489237 after retry RPC after error@439699544) -> (continuation of Deferred@1301026061 after retry RPC after error@824729858) -> (continuation of Deferred@1846818131 after retry RPC after error@1582552897) -> (continuation of Deferred@1935316475 after retry RPC after error@25746147) -> (continuation of Deferred@1316604204 after retry RPC after error@248575613) -> (continuation of Deferred@688017169 after retry RPC after error@1847252752) -> (continuation of Deferred@1856652118 after retry RPC after error@1732256736) -> (continuation of Deferred@1543607006 after retry RPC after error@1679518745) -> (continuation of Deferred@1477915455 after retry RPC after error@1043219710) -> (continuation of Deferred@1860810375 after retry RPC after error@1370318055) -> (continuation of Deferred@818031398 after retry RPC after error@2089255028) -> (continuation of Deferred@1610173677 after retry RPC after error@1699316137) -> (continuation of Deferred@1148394813 after retry RPC after error@70758887) -> (continuation of Deferred@297540520 after retry RPC after error@944866559) -> (continuation of Deferred@1679289405 after retry RPC after error@1570161105) -> (continuation of Deferred@747036816 after retry RPC after error@407175043) -> (continuation of Deferred@1130991282 after retry RPC after error@681203527) -> (continuation of Deferred@864268452 after retry RPC after error@201652656) -> (continuation of Deferred@51899036 after retry RPC after error@2043524566)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.91.124:35565
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:41.751 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:41.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.757 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.758 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.758 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.758 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.760 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.760 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.777 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.777 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.777 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.778 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.778 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.778 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.778 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.778 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.778 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.779 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.797 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.798 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.798 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.799 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.817 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.817 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.817 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:41.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.819 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.819 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.837 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.837 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.837 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.838 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.877 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.877 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.877 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.878 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.896 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:41.896 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:41.896 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:41.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:41.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:41.898 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.898 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:41.898 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:41.899 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:41.899 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:41.899 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:41.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:41.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:41.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:41.900 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:42.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.068 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:42.068 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:42.068 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:42.068 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:42.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:42.068 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:42.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:42.068 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:42.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:42.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:42.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:42.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:42.069 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:42.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:42.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:42.079 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:42.080 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:42.080 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:42.080 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:42.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:42.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:42.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:42.081 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:42.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:42.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:42.081 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:42.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.157 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:42.157 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:42.157 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:42.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.160 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114402158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:42.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.160 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:42.175 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:42.176 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:42.176 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:42.176 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.176 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.176 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.177 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:42.180 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
14:26:42.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
14:26:42.319 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:42.319 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:42.319 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:42.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:42.320 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:42.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:42.320 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:42.320 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:42.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:42.320 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:42.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:42.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:42.320 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:42.324 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.454 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:42.454 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:42.454 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:42.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:42.508 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:42.508 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:42.508 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:42.509 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.509 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:42.510 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.510 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.510 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.510 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.510 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.511 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.511 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:42.513 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:42.514 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:42.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.597 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:42.597 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:42.597 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:42.597 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.598 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.598 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.598 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.598 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.598 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.598 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.598 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:42.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.660 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114402658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:42.674 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
14:26:42.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
14:26:42.717 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:42.717 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:42.717 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:42.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:42.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:42.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:42.719 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:42.268402 22998 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 22993
14:26:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:42.778373 22993 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.904s	user 0.563s	sys 1.062s
14:26:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:42.778726 22993 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.904s	user 0.563s	sys 1.062s
14:26:42.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:40.874405 23000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:42.781635 23002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:42.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:42.783818 23001 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1904 milliseconds
14:26:42.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.783880 22993 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:42.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.785120 22993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:42.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.787324 22993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:42.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.788731 22993 hybrid_clock.cc:648] HybridClock initialized: now 1779114402788707 us; error 76 us; skew 500 ppm
14:26:42.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.789561 22993 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:42.792 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:42.792 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:42.792 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:42.792 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.792 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.792 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:42.792 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.792 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:42.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:42.792 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:42.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.796183 22993 webserver.cc:533] Webserver started at http://127.21.234.2:45787/ using document root <none> and password file <none>
14:26:42.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.797111 22993 fs_manager.cc:362] Metadata directory not provided
14:26:42.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.797349 22993 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:42.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.797820 22993 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:42.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.802623 22993 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data/instance:
14:26:42.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2410af928954a1d9d406c3d02ffe411"
14:26:42.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:42 on dist-test-slave-1n46"
14:26:42.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.803817 22993 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal/instance:
14:26:42.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2410af928954a1d9d406c3d02ffe411"
14:26:42.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:42 on dist-test-slave-1n46"
14:26:42.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.811517 22993 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
14:26:42.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.817358 23010 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:42.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.818468 22993 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.818739 22993 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e2410af928954a1d9d406c3d02ffe411"
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:42 on dist-test-slave-1n46"
14:26:42.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.819131 22993 fs_report.cc:389] FS layout report
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data/data
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:42.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:42.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:42.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:42.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:42.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.879475 22993 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:42.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.881064 22993 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:42.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.881593 22993 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:42.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.884431 22993 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:42.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.889021 22993 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:42.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.889304 22993 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:42.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.889514 22993 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:42.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:42.889705 22993 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:42.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.055802 22993 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.2:46667
14:26:43.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.055868 23122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.2:46667 every 8 connection(s)
14:26:43.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.058876 22993 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/data/info.pb
14:26:43.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.062556 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 22993
14:26:43.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.062996 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-1/wal/instance
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.082196 22440 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/logs
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data/info.pb
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.3:0
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.3
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.3
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:43.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:43.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.113379 23123 heartbeater.cc:344] Connected to a master server at 127.21.234.61:40633
14:26:43.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.113883 23123 heartbeater.cc:461] Registering TS with master...
14:26:43.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.115098 23125 heartbeater.cc:344] Connected to a master server at 127.21.234.62:34045
14:26:43.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.115494 23125 heartbeater.cc:461] Registering TS with master...
14:26:43.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.116362 23123 heartbeater.cc:507] Master 127.21.234.61:40633 requested a full tablet report, sending...
14:26:43.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.116566 23125 heartbeater.cc:507] Master 127.21.234.62:34045 requested a full tablet report, sending...
14:26:43.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.119602 22614 ts_manager.cc:194] Registered new tserver with Master: e2410af928954a1d9d406c3d02ffe411 (127.21.234.2:46667)
14:26:43.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.119952 22485 ts_manager.cc:194] Registered new tserver with Master: e2410af928954a1d9d406c3d02ffe411 (127.21.234.2:46667)
14:26:43.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.124640 23124 heartbeater.cc:344] Connected to a master server at 127.21.234.60:44393
14:26:43.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.124958 23124 heartbeater.cc:461] Registering TS with master...
14:26:43.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.125753 23124 heartbeater.cc:507] Master 127.21.234.60:44393 requested a full tablet report, sending...
14:26:43.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.127858 22694 ts_manager.cc:194] Registered new tserver with Master: e2410af928954a1d9d406c3d02ffe411 (127.21.234.2:46667)
14:26:43.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.129624 22694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.234.2:60605
14:26:43.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114403159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:43.167 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
14:26:43.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
14:26:43.218 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:43.219 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:43.219 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:43.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.219 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.219 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.219 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.219 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:43.261 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:43.261 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:43.261 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:43.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.261 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:43.307 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:43.307 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:43.307 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:43.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.308 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.308 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.308 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:43.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.320 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:43.320 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:43.321 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:43.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.321 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:43.321 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.321 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.321 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:43.321 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.321 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.321 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:43.321 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:43.379 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:43.379 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:43.379 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:43.379 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.379 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.379 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.379 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.379 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.379 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:43.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.440323 23133 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:43.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.440950 23133 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:43.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.441483 23133 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:43.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.478291 23133 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:43.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.479214 23133 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.234.3
14:26:43.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.517580 23133 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.234.20:39625
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.234.3:0
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data/info.pb
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.234.3
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.234.3
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/logs
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:43.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.518922 23133 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:43.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:43.520687 23133 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:43.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.534974 23139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:43.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:43.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:43.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:43.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.555 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.555 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.555 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.555 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.556 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:43.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114403658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:43.671 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:26:43.675 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
14:26:43.762 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:43.763 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:43.763 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:43.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.764 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:43.767 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:43.767 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:43.767 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:43.767 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.767 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:43.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:43.768 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.768 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.768 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:43.768 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:43.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:43.836 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:43.837 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:43.837 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:43.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.838 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:43.975 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:43.975 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:43.975 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:43.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:43.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:43.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:43.977 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:43.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.109 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:44.109 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:44.109 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:44.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:44.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:44.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:44.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:44.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:44.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:44.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:44.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:44.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:44.111 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:44.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:44.133054 23124 heartbeater.cc:499] Master 127.21.234.60:44393 was elected leader, sending a full tablet report...
14:26:44.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114404158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:44.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
14:26:44.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
14:26:44.192 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:44.193 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:44.193 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:44.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:44.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:44.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:44.193 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:44.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:44.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:44.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:44.194 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:44.194 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:44.194 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:44.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.326 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:44.327 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:44.327 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:44.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:44.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:44.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:44.328 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:44.328 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:44.328 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:44.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:44.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:44.328 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:44.328 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:44.427 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:44.427 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:44.428 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:44.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.428 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.428 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.429 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.429 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:44.437 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:44.437 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:44.437 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:44.437 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:44.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:44.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:44.438 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:44.438 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:44.438 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:44.438 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:44.438 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:44.438 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:44.438 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:44.494 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:44.494 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:44.494 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:44.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:44.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:44.495 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:44.495 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:44.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:44.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:44.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:44.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:44.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:44.495 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:44.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.590 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:44.590 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:44.590 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:44.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:44.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:44.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:44.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:44.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:44.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:44.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:44.591 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:44.592 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:44.592 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:44.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114404658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:44.669 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:44.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
14:26:44.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:44.841 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:44.841 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:44.841 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:44.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:44.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:44.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:44.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:44.919 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:44.920 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:44.920 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:44.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:44.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:44.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:44.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:44.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:44.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:44.921 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:44.921 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:44.921 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:44.921 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:45.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.033 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:45.033 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:45.033 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:45.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:45.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:45.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:45.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:45.033 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:45.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:45.033 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:45.034 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:45.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:45.034 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:45.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114405158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:45.169 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:45.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
14:26:45.241 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:45.241 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:45.241 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:45.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.242 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.242 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.242 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.243 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:45.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:44.937362 23138 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 23133
14:26:45.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:43.535954 23140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:45.287787 23138 kernel_stack_watchdog.cc:198] Thread 23133 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:26:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:26:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:26:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:26:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:26:45.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:45.289000 23133 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.754s	user 0.551s	sys 1.121s
14:26:45.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:45.289350 23133 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.755s	user 0.551s	sys 1.121s
14:26:45.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:45.290693 23142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:45.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:45.294371 23141 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1758 milliseconds
14:26:45.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.294396 23133 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.295670 23133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:45.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.297856 23133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:45.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.299280 23133 hybrid_clock.cc:648] HybridClock initialized: now 1779114405299248 us; error 31 us; skew 500 ppm
14:26:45.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.300288 23133 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:45.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.306859 23133 webserver.cc:533] Webserver started at http://127.21.234.3:39085/ using document root <none> and password file <none>
14:26:45.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.307802 23133 fs_manager.cc:362] Metadata directory not provided
14:26:45.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.307982 23133 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:45.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.308382 23133 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:45.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.312778 23133 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data/instance:
14:26:45.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d8f5b62daa24337b68f63e539a22a3a"
14:26:45.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:45 on dist-test-slave-1n46"
14:26:45.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.313895 23133 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal/instance:
14:26:45.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d8f5b62daa24337b68f63e539a22a3a"
14:26:45.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:45 on dist-test-slave-1n46"
14:26:45.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.321616 23133 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
14:26:45.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.327126 23151 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.328122 23133 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
14:26:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.328413 23133 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal
14:26:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d8f5b62daa24337b68f63e539a22a3a"
14:26:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:45 on dist-test-slave-1n46"
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.328708 23133 fs_report.cc:389] FS layout report
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data/data
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:45.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:45.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.392863 23133 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:45.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.394454 23133 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:45.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.394979 23133 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:45.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.397869 23133 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:45.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.402606 23133 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:45.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.402822 23133 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:45.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.403122 23133 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:45.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.403419 23133 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:45.412 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:45.412 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:45.412 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:45.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:45.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:45.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:45.413 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:45.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:45.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:45.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:45.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:45.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:45.413 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:45.475 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RESTARTING to RUNNING.
14:26:45.476 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 77d052e6e51b5ae35525074f80512696 from Checkpoint 68 @ 1779114274306 for 77d052e6e51b5ae35525074f80512696 located at file:/tmp/junit3594006726440257599/checkpoints/77d052e6e51b5ae35525074f80512696/chk-68.
14:26:45.477 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
14:26:45.477 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:45.478 [INFO - Thread-68] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:45.478 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
14:26:45.478 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.13.91.124:35565(127.13.91.124:35565)] disconnecting while in state TERMINATED
14:26:45.478 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.13.91.126:39961(127.13.91.126:39961)] disconnecting while in state TERMINATED
14:26:45.479 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.13.91.125:45957(127.13.91.125:45957)] disconnecting while in state TERMINATED
14:26:45.479 [DEBUG - Thread-68] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:45.479 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:45.480 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
14:26:45.480 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0
14:26:45.481 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
14:26:45.481 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:26:45.481 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:45.481 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
14:26:45.481 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id cb555096141ea039362313f4d0c0e292
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id ac09fd07ba20b4a0c2514eaa59e5c2a0.
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31
14:26:45.482 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
14:26:45.483 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:45.483 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
14:26:45.483 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1) with allocation id c60b799928fc74d0a31957405e41241b
14:26:45.483 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot cb555096141ea039362313f4d0c0e292.
14:26:45.484 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id cb555096141ea039362313f4d0c0e292.
14:26:45.484 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
14:26:45.484 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
14:26:45.484 [INFO - Thread-68] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:45.485 [INFO - Thread-68] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:45.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f169adf
14:26:45.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:45.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:45.486 [DEBUG - Thread-68] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.487 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:26:45.487 [INFO - Thread-68] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:45.487 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
14:26:45.496 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@306305c1
14:26:45.499 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.499 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 286cf6c9ecd3147ec1f81cc1b5086f31.
14:26:45.500 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 286cf6c9ecd3147ec1f81cc1b5086f31.
14:26:45.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.500 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
14:26:45.500 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
14:26:45.501 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ff03ced
14:26:45.501 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:45.501 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:45.501 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:26:45.501 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
14:26:45.503 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot c60b799928fc74d0a31957405e41241b.
14:26:45.504 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52704b9
14:26:45.504 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id c60b799928fc74d0a31957405e41241b.
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fa6960d
14:26:45.505 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:45.506 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:45.506 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:26:45.506 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
14:26:45.506 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.506 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:45.507 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:45.507 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:45.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:45.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:45.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:45.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:45.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:45.507 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:45.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:45.507 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:45.507 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:45.507 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:45.507 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ee41c59
14:26:45.507 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:45.508 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3594006726440257599/checkpoints")
14:26:45.508 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:26:45.508 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
14:26:45.509 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48e1c549
14:26:45.509 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1be8acea
14:26:45.510 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.511 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:45.511 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:45.511 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:45.511 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:45.514 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.515 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.516 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.517 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.517 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.518 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.518 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.518 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.518 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.518 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.519 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.519 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.519 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.526 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.526 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.531 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.532 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.532 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.532 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.532 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.533 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.533 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.533 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.534 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.534 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.534 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.534 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.534 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.534 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.535 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.535 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.536 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.537 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.537 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.538 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.539 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.540 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.543 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.554 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.554 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.556 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.558 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.558 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.559 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.558 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.559 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.560 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.560 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.560 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.567 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.567 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.570 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.570 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.570 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.570 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.571 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.571 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.571 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.571 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.578 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.578 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.578 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.578 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.580 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.582 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.582 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.582 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.583 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:45.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:45.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:45.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.588 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.588 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.588 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.589 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:45.590 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.590 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.590 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.590 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.592 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.593 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.594 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.594 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.594 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.595 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.596 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.596 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.596 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.596 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.596 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.596 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.597 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.598 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.598 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.598 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.599 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.599 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.606 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.607 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.607 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.610 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.610 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.610 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.610 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.610 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.611 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.611 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.611 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.612 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.612 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.613 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.613 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.613 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.614675 23133 rpc_server.cc:307] RPC server started. Bound to: 127.21.234.3:42127
14:26:45.615 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.614917 23314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.234.3:42127 every 8 connection(s)
14:26:45.615 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.616 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.617 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.617 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.618 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.618 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.618 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.618 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.618 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.618402 23133 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/data/info.pb
14:26:45.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.618 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.619 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.619 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.619 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.619 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.619 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.619 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.619 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.619 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.620 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.620 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.620 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.620 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.620 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.620 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.620 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.620 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.620 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.627077 22440 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23133
14:26:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.627699 22440 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6103497362718929246/ts-2/wal/instance
14:26:45.635 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.635 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.635 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.636 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.636 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.636 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.636 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.636 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.636 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.636 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.637 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.637 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.637 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.637 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.637 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.638 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.638 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.638 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.638 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.638 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.638 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.638 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.638 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.638 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.638 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.639 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.640 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.640 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.640 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.641 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.640 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.641 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.641 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.642 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.642 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.642 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.642 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.642 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.643 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.643 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.643 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.654 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.654 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.654 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.655 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.655 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.656 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.656 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.656 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.656 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.656 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.657 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.657 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114405658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:45.659 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.659 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.659 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.660 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.660 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.660 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.660 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.660 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.660 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.660 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.661 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.661 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.661 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.661 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.661 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.661 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.661 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.662 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.662 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.669 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:45.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
14:26:45.675 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.675 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.675 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.675 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.675 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.676 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.676 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.677 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.678 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.678 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.678 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.678 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.679 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.696 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.697 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.697 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.697 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.697 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.699 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.699 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.699 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.700 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.700 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.712939 23317 heartbeater.cc:344] Connected to a master server at 127.21.234.61:40633
14:26:45.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.713469 23317 heartbeater.cc:461] Registering TS with master...
14:26:45.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.714828 23317 heartbeater.cc:507] Master 127.21.234.61:40633 requested a full tablet report, sending...
14:26:45.718 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.718 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.718 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.717852 22614 ts_manager.cc:194] Registered new tserver with Master: 3d8f5b62daa24337b68f63e539a22a3a (127.21.234.3:42127)
14:26:45.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.719 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.720 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.720 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.720 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.718940 23318 heartbeater.cc:344] Connected to a master server at 127.21.234.60:44393
14:26:45.721 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.719265 23318 heartbeater.cc:461] Registering TS with master...
14:26:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.720196 23318 heartbeater.cc:507] Master 127.21.234.60:44393 requested a full tablet report, sending...
14:26:45.721 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.722326 22694 ts_manager.cc:194] Registered new tserver with Master: 3d8f5b62daa24337b68f63e539a22a3a (127.21.234.3:42127)
14:26:45.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.724077 22694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.234.3:56331
14:26:45.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.729285 23321 heartbeater.cc:344] Connected to a master server at 127.21.234.62:34045
14:26:45.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.729595 23321 heartbeater.cc:461] Registering TS with master...
14:26:45.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.730211 23321 heartbeater.cc:507] Master 127.21.234.62:34045 requested a full tablet report, sending...
14:26:45.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.732632 22485 ts_manager.cc:194] Registered new tserver with Master: 3d8f5b62daa24337b68f63e539a22a3a (127.21.234.3:42127)
14:26:45.737 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.737 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.737 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:45.738013 22440 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:26:45.738 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.738 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.738 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.751 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:26:45.751 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:26:45.752 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.234.62"
      port: 34045
    }
    bound_http_address {
      host: "127.21.234.62"
      port: 37327
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.234.61"
      port: 40633
    }
    bound_http_address {
      host: "127.21.234.61"
      port: 37881
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.234.60"
      port: 44393
    }
    bound_http_address {
      host: "127.21.234.60"
      port: 35601
    }
  }
}

14:26:45.752 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:26:45.753 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.234.1"
      port: 36065
    }
    bound_http_address {
      host: "127.21.234.1"
      port: 39367
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.234.2"
      port: 46667
    }
    bound_http_address {
      host: "127.21.234.2"
      port: 45787
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.234.3"
      port: 42127
    }
    bound_http_address {
      host: "127.21.234.3"
      port: 39085
    }
  }
}

14:26:45.753 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:26:45.754 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.755 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.755 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:45.755 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.755 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:26:45.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.755 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:45.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.755 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHAyHVV/test-tmp
14:26:45.755 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:45.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.755 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:45.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.756 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:26:45.756 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.756 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.756 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.756 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHAyHVV/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:26:45.756 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.756 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.756 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.756 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:45.756 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.756 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.757 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.757 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.757 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.757 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.757 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.757 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.757 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.757 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.759 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.759 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.759 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.759 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.759 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.759 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.759 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.759 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.759 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.759 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.759 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.759 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.762 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:26:45.799 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:45.799 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:45.799 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:45.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.799 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.799 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:45.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.799 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:45.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.799 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:45.800 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:45.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:45.820 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.821 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.821 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.821 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.821 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.821 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.834 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.834 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.834 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.835 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.835 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.835 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.835 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.835 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.835 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.835 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.835 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.835 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.835 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.840 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.840 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.840 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.840 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.840 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.840 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.840 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.840 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.840 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.859 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.859 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.859 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.859 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.900 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:45.900 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:45.900 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:45.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.900 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.900 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:45.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:45.900 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:45.900 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:45.914 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:45.914 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:45.914 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:45.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:45.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:45.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:45.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:45.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:45.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:45.914 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:45.914 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:45.914 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:45.915 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:45.937 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.937 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.937 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.938 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.939 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:45.939 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:45.940 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:45.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:45.940 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.940 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:45.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.940 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.940 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:45.940 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:45.958 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.958 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.958 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.958 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.958 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.958 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.958 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.958 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:45.975 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:45.975 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:45.975 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:45.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:45.975 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.975 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.975 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.975 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.975 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:45.975 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:45.975 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.077 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:46.077 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:46.077 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:46.077 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.077 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.077 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.078 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.078 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.078 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:46.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.119 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.119 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.119 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.119 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.119 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.119 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.119 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.119 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.120 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.120 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.129 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:26:46.129 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:26:46.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.132964 23327 mini_oidc.cc:150] Starting JWKS server
14:26:46.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.137368 23327 webserver.cc:533] Webserver started at http://127.0.0.1:34665/ using document root <none> and password file <none>
14:26:46.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.137845 23327 mini_oidc.cc:186] Starting OIDC Discovery server
14:26:46.139 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.139 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.139 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.139 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.139657 23327 webserver.cc:533] Webserver started at http://127.0.0.1:35221/ using document root <none> and password file <none>
14:26:46.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.140 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114406158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:46.165 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:26:46.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
14:26:46.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:26:46.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:26:46Z Disabled control of system clock
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.205266 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/logs
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data/info.pb
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.254:42535
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.254
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json with env {}
14:26:46.257 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.257 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.257 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.258 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.258 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.258 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.314 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.315 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.315 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.377 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.378 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.378 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.378 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:46.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.500 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:46.500 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:46.501 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:46.501 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:46.501 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:46.501 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:46.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:46.501 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:46.501 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:46.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:46.501 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:46.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:46.501 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:46.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.531221 23339 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:46.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.531889 23339 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:46.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.532505 23339 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:46.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.566027 23339 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:46.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.566392 23339 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:46.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.566699 23339 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.567013 23339 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.567324 23339 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.567623 23339 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34665/jwks.json
14:26:46.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.606343 23339 master_runner.cc:387] Master server non-default flags:
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:46.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.254:42535
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data/info.pb
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.254
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/logs
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:46.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:46.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.607883 23339 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:46.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.609583 23339 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:46.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.622438 23345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:46.623 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:46.624 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:46.624 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:46.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.624 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.624 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.624 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.625 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.625 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.625 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.625 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:46.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:46.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:46.639 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:46.639 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:46.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:46.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:46.640 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:46.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114406658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:46.670 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:26:46.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
14:26:46.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:46.727927 23318 heartbeater.cc:499] Master 127.21.234.60:44393 was elected leader, sending a full tablet report...
14:26:46.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:46.994 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:46.994 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:46.994 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:46.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.995 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:46.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:46.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:46.995 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:46.996 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:46.996 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:46.996 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:46.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:46.997 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.997 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.997 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:46.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:46.997 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:47.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:47.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:47.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:47.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.102 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.102 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.102 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:47.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.135 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:47.135 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:47.135 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:47.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:47.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:47.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:47.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:47.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:47.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:47.136 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:47.136 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:47.136 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:47.136 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:47.140 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:47.141 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:47.141 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:47.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:47.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:47.143 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.143 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.143 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:47.143 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:47.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114407159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:47.172 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:26:47.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
14:26:47.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.257 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:47.258 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:47.258 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:47.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.259 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.259 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.259 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.259 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:47.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:47.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:47.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:47.302 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.302 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.302 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.303 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:47.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.334 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:47.334 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:47.334 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:47.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.336 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:47.368 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:47.369 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:47.369 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:47.369 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:47.369 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:47.369 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:47.369 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:47.369 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:47.369 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:47.370 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:47.370 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:47.370 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:47.370 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:47.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114407658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:47.669 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:47.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
14:26:47.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:47.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:47.754 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:47.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.755 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.756 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:47.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:47.827 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:47.827 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:47.827 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:47.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:47.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:47.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:47.827 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:47.934 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:47.934 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:47.934 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:47.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:47.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:47.935 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:47.936 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.626422 23348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:46.624933 23346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:47.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:47.981724 23347 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1357 milliseconds
14:26:47.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.981828 23339 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:26:47.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.983348 23339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:47.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.985824 23339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:47.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.987177 23339 hybrid_clock.cc:648] HybridClock initialized: now 1779114407987136 us; error 45 us; skew 500 ppm
14:26:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.988018 23339 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:47.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.994115 23339 webserver.cc:533] Webserver started at http://127.22.199.254:43587/ using document root <none> and password file <none>
14:26:47.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.995064 23339 fs_manager.cc:362] Metadata directory not provided
14:26:47.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.995301 23339 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:47.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:47.995797 23339 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:48.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.000219 23339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data/instance:
14:26:48.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff7a0965b1d847f6a8670f1caecb7872"
14:26:48.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:47 on dist-test-slave-1n46"
14:26:48.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.001607 23339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal/instance:
14:26:48.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff7a0965b1d847f6a8670f1caecb7872"
14:26:48.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:47 on dist-test-slave-1n46"
14:26:48.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.009701 23339 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:26:48.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.015569 23356 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:48.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.016685 23339 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
14:26:48.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.017040 23339 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal
14:26:48.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff7a0965b1d847f6a8670f1caecb7872"
14:26:48.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:47 on dist-test-slave-1n46"
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.017426 23339 fs_report.cc:389] FS layout report
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data/data
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:48.067 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:48.068 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:48.068 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:48.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:48.068 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:48.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:48.068 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:48.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:48.068 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:48.068 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:48.068 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:48.068 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:48.068 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:48.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.077420 23339 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:48.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.078914 23339 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:48.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.079376 23339 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:48.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:48.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:48.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:48.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:48.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:48.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:48.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:48.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:48.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:48.101 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:48.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:48.102 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:48.102 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:48.106 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:48.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:48.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:48.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:48.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114408158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:48.167 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:48.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
14:26:48.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.175035 23339 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.254:42535
14:26:48.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.175087 23407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.254:42535 every 8 connection(s)
14:26:48.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.177850 23339 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/data/info.pb
14:26:48.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.184402 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:48.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.186475 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23339
14:26:48.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.186964 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-0/wal/instance
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.190876 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/logs
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data/info.pb
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.253:33945
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.253
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:48.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json with env {}
14:26:48.196 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:48.197 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:48.197 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:48.197 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.197 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.197 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.197 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.197 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.197 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.198 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:48.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.196547 23408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } has no permanent_uuid. Determining permanent_uuid...
14:26:48.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.229451 23408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } has no permanent_uuid. Determining permanent_uuid...
14:26:48.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.232064 23360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.236116 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.285485 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 1
14:26:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.290017 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.295 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:48.295 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:48.295 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:48.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:48.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:48.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:48.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:48.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:48.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:48.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:48.295 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:48.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:48.295 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:48.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.358482 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 2
14:26:48.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.362622 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:48.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:48.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:48.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:48.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:48.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.442 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.442 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:48.442 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:48.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.454063 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 3
14:26:48.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.458552 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.530558 23410 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:48.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.531183 23410 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:48.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.531706 23410 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:48.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.565500 23410 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:48.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.566010 23410 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:48.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.566377 23410 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:48.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.566669 23410 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:48.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.566962 23410 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:48.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.567211 23410 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34665/jwks.json
14:26:48.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.601924 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 4
14:26:48.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.606323 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.607556 23410 master_runner.cc:387] Master server non-default flags:
14:26:48.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:48.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:48.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.253:33945
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data/info.pb
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.253
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/logs
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:48.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:48.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.608927 23410 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:48.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.610859 23410 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:48.617 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:48.617 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:48.618 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:48.618 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.618 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.618 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.619 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:48.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.623004 23419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:48.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114408658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:48.667 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:48.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
14:26:48.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:48.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:48.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:48.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:48.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.900 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:48.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:48.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.900 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.900 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:48.900 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:48.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:48.905762 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 5
14:26:48.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.913362 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:48.942 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:48.943 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:48.943 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:48.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:48.943 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:48.943 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:48.943 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:48.943 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:48.943 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:48.943 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:48.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:48.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:48.943 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:48.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:48.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:48.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:48.973 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:48.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:48.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:48.974 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:48.974 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:48.974 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:48.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:48.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:48.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:48.976 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:48.999 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.160 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114409159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:49.177 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
14:26:49.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
14:26:49.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:49.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:49.197 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:49.197 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.198 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.199 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.199 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.199 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:49.267 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:49.267 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:49.267 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:49.268 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:49.268 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:49.268 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:49.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:49.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:49.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:49.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:49.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:49.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:49.269 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:49.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.378 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:49.378 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:49.378 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:49.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.379 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.379 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.379 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.380 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:49.440 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:49.440 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:49.440 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:49.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.441 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.441 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.442 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:49.447 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:49.447 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:49.447 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:49.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.448 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.448 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.449 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.449 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:49.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:49.467473 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 6
14:26:49.492 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:49.492 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:49.493 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:49.493 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:49.493 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:49.493 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:49.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:49.493 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:49.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:49.493 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:49.493 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:49.493 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:49.494 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:49.499 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:49.498073 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.253:33945: Network error: Client connection negotiation failed: client connection to 127.22.199.253:33945: connect: Connection refused (error 111)
14:26:49.519 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:49.519 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:49.519 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:49.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:49.520 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.520 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.520 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:49.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.520 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:49.520 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:49.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114409658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:49.664 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:49.664 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:49.664 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:49.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:49.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:49.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:49.665 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:49.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
14:26:49.674 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
14:26:49.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:49.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.027300 23410 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.402s	user 0.000s	sys 0.001s
14:26:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.026082 23418 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 23410
14:26:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.028704 23410 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.403s	user 0.000s	sys 0.002s
14:26:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:48.624311 23420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:50.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.029837 23422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.034842 23410 server_base.cc:1061] running on GCE node
14:26:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.036224 23410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.039109 23410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:50.040 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.040580 23410 hybrid_clock.cc:648] HybridClock initialized: now 1779114410040494 us; error 77 us; skew 500 ppm
14:26:50.041 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:50.041 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:50.041 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:50.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:50.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:50.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:50.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:50.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:50.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:50.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:50.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:50.041 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.041743 23410 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:50.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.048607 23410 webserver.cc:533] Webserver started at http://127.22.199.253:42875/ using document root <none> and password file <none>
14:26:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.049861 23410 fs_manager.cc:362] Metadata directory not provided
14:26:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.050140 23410 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.050633 23410 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:50.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.056593 23410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data/instance:
14:26:50.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62685b9971d649a097e3481849cab2d0"
14:26:50.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:50 on dist-test-slave-1n46"
14:26:50.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.058112 23410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal/instance:
14:26:50.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62685b9971d649a097e3481849cab2d0"
14:26:50.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:50 on dist-test-slave-1n46"
14:26:50.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.067257 23410 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.004s
14:26:50.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.072948 23435 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.073927 23410 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
14:26:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.074270 23410 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal
14:26:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62685b9971d649a097e3481849cab2d0"
14:26:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:50 on dist-test-slave-1n46"
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.074554 23410 fs_report.cc:389] FS layout report
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data/data
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:50.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:50.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:50.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:50.101 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:50.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:50.101 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:50.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:50.101 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:50.101 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:50.101 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:50.102 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:50.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:50.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:50.102 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:50.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.132467 23410 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:50.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.134143 23410 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:50.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.134619 23410 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:50.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114410158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:50.167 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:50.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
14:26:50.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.222079 23410 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.253:33945
14:26:50.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.222153 23486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.253:33945 every 8 connection(s)
14:26:50.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.224866 23410 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/data/info.pb
14:26:50.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.231570 23487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:50.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.232734 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23410
14:26:50.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.233136 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-1/wal/instance
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.235299 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/logs
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data/info.pb
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.252:43961
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.252
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json with env {}
14:26:50.239 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:50.239 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:50.239 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:50.240 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.240 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.240 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.240 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.240 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.240 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.240 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.240 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.240 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.240 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:50.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.246287 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } has no permanent_uuid. Determining permanent_uuid...
14:26:50.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.273458 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } has no permanent_uuid. Determining permanent_uuid...
14:26:50.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.288336 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } has no permanent_uuid. Determining permanent_uuid...
14:26:50.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.290939 23437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.295094 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.307 [DEBUG - pool-398-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [8ms] received response from server master-127.19.148.60:37365: OK, deferred=null) with no deferred attached!
14:26:50.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.344565 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 1
14:26:50.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.349285 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:50.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:50.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:50.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.368 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:50.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.385298 23404 debug-util.cc:398] Leaking SignalData structure 0x7b080007d5a0 after lost signal to thread 23340
14:26:50.388 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:50.388 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:50.388 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:50.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:50.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:50.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:50.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:50.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:50.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:50.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:50.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:50.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:50.389 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:50.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.417678 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 2
14:26:50.419 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:50.420 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:50.420 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:50.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.420 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.420 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.420 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.421 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:50.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.424062 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.515472 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 3
14:26:50.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.520315 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.558655 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } attempt: 7
14:26:50.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.578133 23408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } has no permanent_uuid. Determining permanent_uuid...
14:26:50.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.584820 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.596937 23489 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:50.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.597527 23489 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:50.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.598181 23489 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:50.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.638785 23489 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:26:50.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.639178 23489 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:50.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.639505 23489 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:26:50.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.639815 23489 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:26:50.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.640152 23489 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:26:50.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.640444 23489 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34665/jwks.json
14:26:50.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.643270 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 1
14:26:50.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.647938 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114410658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:50.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.663797 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 4
14:26:50.667 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
14:26:50.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
14:26:50.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.669103 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.689611 23489 master_runner.cc:387] Master server non-default flags:
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.252:43961
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34665/jwks.json
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data/info.pb
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.252
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/logs
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:50.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:50.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.691113 23489 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:50.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.692706 23489 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:50.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.706871 23502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:50.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:50.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:50.716 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:50.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:50.717 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.717 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.717 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:50.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:50.717 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:50.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.729355 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 2
14:26:50.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.735888 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.747 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:50.747 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:50.747 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:50.747 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:50.747 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:50.747 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:50.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:50.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:50.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:50.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:50.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:50.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:50.748 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:50.795 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:50.795 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:50.795 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:50.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.795 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.795 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.795 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.796 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.796 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.796 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:50.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:50.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.821300 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 3
14:26:50.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.831228 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.893 [DEBUG - pool-402-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [6ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.893 [DEBUG - pool-402-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [11ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.893 [DEBUG - pool-402-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [10ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.929 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:50.929 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:50.929 [DEBUG - pool-428-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:50.929 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:50.929 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:50.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:50.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:50.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:50.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:50.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:50.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:50.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:50.930 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:50.931 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28586), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [153ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [157ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [158ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [399ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [400ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [434ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [444ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [455ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [455ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [475ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [484ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [485ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [486ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [501ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [522ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [541ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [542ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [582ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [622ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [622ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [803ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1183ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1422ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3062ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [6000ms] too many traces: truncated at 100 traces, deferred=Deferred@74314085(state=PENDING, result=null, callback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664), errback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664)))
14:26:50.932 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
14:26:50.932 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28586), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [153ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [157ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [158ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [399ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [400ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [434ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [444ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [455ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [455ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [475ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [484ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [485ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [486ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [501ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [522ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [541ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [542ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [582ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [622ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [622ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [803ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1183ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1422ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3062ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [6000ms] too many traces: truncated at 100 traces, deferred=Deferred@74314085(state=PENDING, result=null, callback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664), errback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:50.933 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
14:26:50.936 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
14:26:50.939 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED on a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28586), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [153ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [157ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [158ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [399ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [400ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [434ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [444ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [455ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [455ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [475ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [484ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [485ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [486ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [501ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [501ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [522ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [541ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [542ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [581ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [582ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [621ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [622ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [622ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [803ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1183ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [1422ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.188:46025: Network error: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.190:44713: Network error: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.15.248.189:37707: Network error: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [3062ms] delaying RPC due to: Service unavailable: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.188:46025, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.190:44713, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.248.189:37707, [6000ms] too many traces: truncated at 100 traces, deferred=Deferred@74314085(state=PENDING, result=null, callback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664), errback=(continuation of Deferred@2109047527 after retry RPC after error@1865139068) -> (continuation of Deferred@721614273 after retry RPC after error@1083166493) -> (continuation of Deferred@293396305 after retry RPC after error@545115681) -> (continuation of Deferred@485333778 after retry RPC after error@572803253) -> (continuation of Deferred@1431674359 after retry RPC after error@462900666) -> (continuation of Deferred@1808953553 after retry RPC after error@1806957822) -> (continuation of Deferred@309358170 after retry RPC after error@858458931) -> (continuation of Deferred@1267183999 after retry RPC after error@1059578109) -> (continuation of Deferred@783567869 after retry RPC after error@1160621963) -> (continuation of Deferred@861401624 after retry RPC after error@871877767) -> (continuation of Deferred@1066435239 after retry RPC after error@392770345) -> (continuation of Deferred@463652078 after retry RPC after error@381460713) -> (continuation of Deferred@755141923 after retry RPC after error@1940657105) -> (continuation of Deferred@2116304126 after retry RPC after error@233599035) -> (continuation of Deferred@876519216 after retry RPC after error@664744189) -> (continuation of Deferred@2021862204 after retry RPC after error@369156543) -> (continuation of Deferred@1443310416 after retry RPC after error@138535349) -> (continuation of Deferred@1778053450 after retry RPC after error@2020010195) -> (continuation of Deferred@391381284 after retry RPC after error@270472754) -> (continuation of Deferred@785503706 after retry RPC after error@1631486115) -> (continuation of Deferred@1448403073 after retry RPC after error@1049809663) -> (continuation of Deferred@508411890 after retry RPC after error@191045376) -> (continuation of Deferred@2051188229 after retry RPC after error@1383040664)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.248.189:37707
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:50.940 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
14:26:50.940 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RUNNING to RESTARTING.
14:26:50.941 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:50.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
14:26:50.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.968551 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 5
14:26:50.975 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [13ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.975 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [14ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.975 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [15ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:50.975 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:50.975 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:50.975 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:50.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:50.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:50.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:50.977 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:50.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:50.972473 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 4
14:26:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.985792 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:50.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.986627 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:51.004 [DEBUG - pool-404-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [4ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:51.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:51.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:51.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:51.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.022 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.022 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.022 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.022 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:51.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:51.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:51.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114411159 for job 4459c5bc8e668403214dd967e9f85899.
14:26:51.159 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:51.161 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.161 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.161 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.161 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.161 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.161 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.162 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.162 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.162 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.162 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:51.172 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
14:26:51.174 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
14:26:51.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.215 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:51.215 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:51.215 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:51.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.216 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.216 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.216 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:51.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:51.269295 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 5
14:26:51.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:51.277786 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:51.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.376 [DEBUG - pool-405-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.20.103.125:34309, [3ms] received response from server master-127.20.103.125:34309: OK, deferred=null) with no deferred attached!
14:26:51.419 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:51.419 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:51.419 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:51.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.419 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.420 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.420 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.420 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:51.513 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:51.513 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:51.513 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:51.513 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:51.513 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:51.513 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:51.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:51.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:51.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:51.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:51.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:51.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:51.514 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:51.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:51.534153 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 6
14:26:51.563 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:51.563 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:51.563 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:51.563 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:51.563 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:51.563 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:51.563 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:51.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:51.563 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:51.563 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:51.563 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:51.564 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:51.564 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:51.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:51.565162 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:51.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.639 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:51.639 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:51.639 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:51.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.640 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.640 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:51.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114411658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:51.675 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
14:26:51.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.677 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
14:26:51.678 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:51.678 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:51.678 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:51.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.679 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:51.696 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:51.697 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:51.697 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:51.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.697 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.698 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.698 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.698 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.698 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:51.748 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:51.748 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:51.748 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:51.749 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:51.749 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:51.749 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:51.749 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:51.750 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:51.750 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:51.750 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:51.750 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:51.750 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:51.750 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:51.775 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:51.775 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:51.775 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:51.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.776 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.776 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.777 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.777 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.777 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.777 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.777 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.777 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.777 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:51.787 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:51.787 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:51.788 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:51.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.788 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.788 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.789 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:51.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:51.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:51.830592 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 6
14:26:51.855 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:51.855 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:51.855 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:51.856 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:51.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:51.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:51.858 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:51.858 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:51.859 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:51.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.859 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.859 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:51.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:51.859 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:51.860 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:51.860 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:51.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:51.863334 23408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:51.867 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:51.867 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:51.868 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:51.868 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.868 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.868 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:51.868 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.869 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.869 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:51.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:51.869 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:52.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114412158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:52.168 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:26:52.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
14:26:52.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.254 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:52.254 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:52.255 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:52.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.256 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.256 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.256 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.256 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:52.267 [DEBUG - pool-398-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [3ms] received response from server master-127.19.148.60:37365: OK, deferred=null) with no deferred attached!
14:26:52.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.108307 23501 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 23489
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.525401 23501 kernel_stack_watchdog.cc:198] Thread 23489 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 392ms:
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:26:52.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:50.711651 23503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:52.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.531685 23489 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.819s	user 0.005s	sys 0.000s
14:26:52.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.532160 23489 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.819s	user 0.005s	sys 0.000s
14:26:52.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.534698 23489 server_base.cc:1061] running on GCE node
14:26:52.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.535045 23506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:52.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.536597 23489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:52.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.539664 23489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:52.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.541067 23489 hybrid_clock.cc:648] HybridClock initialized: now 1779114412541030 us; error 39 us; skew 500 ppm
14:26:52.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.541802 23489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:52.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.548673 23489 webserver.cc:533] Webserver started at http://127.22.199.252:43041/ using document root <none> and password file <none>
14:26:52.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.549547 23489 fs_manager.cc:362] Metadata directory not provided
14:26:52.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.549744 23489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:52.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.550271 23489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:52.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.554473 23489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data/instance:
14:26:52.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "81416f1bc0ac4417a0f9fcd3706c8af1"
14:26:52.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:52 on dist-test-slave-1n46"
14:26:52.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.555536 23489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal/instance:
14:26:52.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "81416f1bc0ac4417a0f9fcd3706c8af1"
14:26:52.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:52 on dist-test-slave-1n46"
14:26:52.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.563369 23489 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
14:26:52.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.569747 23518 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:52.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.570912 23489 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:26:52.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.571305 23489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal
14:26:52.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "81416f1bc0ac4417a0f9fcd3706c8af1"
14:26:52.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:52 on dist-test-slave-1n46"
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.571677 23489 fs_report.cc:389] FS layout report
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data/data
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:52.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:52.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.625662 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 7
14:26:52.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:52.633070 23487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.199.252:43961: Network error: Client connection negotiation failed: client connection to 127.22.199.252:43961: connect: Connection refused (error 111)
14:26:52.640 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:52.640 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:52.640 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:52.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:52.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:52.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:52.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:52.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:52.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:52.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:52.641 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:52.641 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:52.641 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:52.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.657016 23489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:52.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114412658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:52.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.658694 23489 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:52.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.659248 23489 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:52.667 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:52.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
14:26:52.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.694 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:52.694 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:52.695 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:52.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:52.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:52.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:52.695 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.778976 23489 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.252:43961
14:26:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.779074 23571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.252:43961 every 8 connection(s)
14:26:52.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.784380 23489 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/data/info.pb
14:26:52.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.791208 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23489
14:26:52.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.791631 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/master-2/wal/instance
14:26:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.792083 23572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:26:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.811637 23572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } has no permanent_uuid. Determining permanent_uuid...
14:26:52.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:52.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:52.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:52.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:52.853 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:52.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:52.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:52.854 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:52.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:52.854 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:52.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:52.854 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:52.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:52.854 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:52.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.861315 23572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } has no permanent_uuid. Determining permanent_uuid...
14:26:52.880 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:52.881 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:52.881 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:52.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:52.881 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:52.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:52.881 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:52.881 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:52.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:52.881 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:52.881 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:52.881 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:52.881 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:52.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.885214 23572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } has no permanent_uuid. Determining permanent_uuid...
14:26:52.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.896862 23408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 7
14:26:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.921631 23572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: Bootstrap starting.
14:26:52.932 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:52.933 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:52.933 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:52.933 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:52.933 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:52.933 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:52.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:52.933 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:52.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:52.933 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:52.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:52.933 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:52.933 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:52.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.936743 23572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: Neither blocks nor log segments found. Creating new log.
14:26:52.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.938721 23572 log.cc:826] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: Log is configured to *not* fsync() on all Append() calls
14:26:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.945124 23572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: No bootstrap required, opened a new log
14:26:52.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.951413 23408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: Bootstrap starting.
14:26:52.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.965250 23408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: Neither blocks nor log segments found. Creating new log.
14:26:52.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.973018 23408 log.cc:826] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: Log is configured to *not* fsync() on all Append() calls
14:26:52.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.975239 23572 raft_consensus.cc:359] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:52.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.976032 23572 raft_consensus.cc:385] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:52.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.976311 23572 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81416f1bc0ac4417a0f9fcd3706c8af1, State: Initialized, Role: FOLLOWER
14:26:52.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.977993 23408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: No bootstrap required, opened a new log
14:26:52.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.977413 23572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:52.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.986248 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:52.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.987103 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: This master's current role is: FOLLOWER
14:26:52.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:52.988134 23572 sys_catalog.cc:565] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: configured and running, proceeding with master startup.
14:26:53.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.006202 23408 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:53.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.006982 23408 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:53.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.007395 23408 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff7a0965b1d847f6a8670f1caecb7872, State: Initialized, Role: FOLLOWER
14:26:53.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.008368 23408 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.017099 23593 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:53.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.021778 23593 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: This master's current role is: FOLLOWER
14:26:53.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.022475 23593 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:26:53.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.023240 23593 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:53.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.021330 23408 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: configured and running, proceeding with master startup.
14:26:53.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.030179 23593 leader_election.cc:290] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62685b9971d649a097e3481849cab2d0 (127.22.199.253:33945), 81416f1bc0ac4417a0f9fcd3706c8af1 (127.22.199.252:43961)
14:26:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.032873 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" is_pre_election: true
14:26:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.033931 23547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff7a0965b1d847f6a8670f1caecb7872 in term 0.
14:26:53.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.035699 23358 leader_election.cc:304] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81416f1bc0ac4417a0f9fcd3706c8af1, ff7a0965b1d847f6a8670f1caecb7872; no voters: 
14:26:53.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.036623 23593 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:26:53.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.037026 23593 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:26:53.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.037449 23593 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 0 FOLLOWER]: Advancing to term 1
14:26:53.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.044512 23593 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:53.048 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:53.048 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:53.048 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:53.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:53.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:53.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:53.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:53.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:53.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:53.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:53.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:53.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:53.050 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:53.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.050905 23593 leader_election.cc:290] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [CANDIDATE]: Term 1 election: Requested vote from peers 62685b9971d649a097e3481849cab2d0 (127.22.199.253:33945), 81416f1bc0ac4417a0f9fcd3706c8af1 (127.22.199.252:43961)
14:26:53.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.051523 23547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1"
14:26:53.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.052150 23547 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 0 FOLLOWER]: Advancing to term 1
14:26:53.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:53.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:53.055 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:53.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:53.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:53.095535 23362 tablet.cc:2404] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:53.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.118551 23547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff7a0965b1d847f6a8670f1caecb7872 in term 1.
14:26:53.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.121567 23358 leader_election.cc:304] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81416f1bc0ac4417a0f9fcd3706c8af1, ff7a0965b1d847f6a8670f1caecb7872; no voters: 
14:26:53.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.122915 23594 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 1 FOLLOWER]: Leader election won for term 1
14:26:53.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.123871 23594 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [term 1 LEADER]: Becoming Leader. State: Replica: ff7a0965b1d847f6a8670f1caecb7872, State: Running, Role: LEADER
14:26:53.127 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:53.127 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:53.127 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:53.127 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.127 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.128 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.128 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.128 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.128 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.128 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.128 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.128 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:53.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.126197 23594 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:53.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114413158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:53.173 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:26:53.174 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
14:26:53.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:53.178673 23605 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:26:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:53.179158 23605 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:26:53.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:53.182394 23526 tablet.cc:2404] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:53.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.142985 23489 master_runner.cc:187] Error getting master registration for 127.22.199.254:42535: OK, instance_id { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" instance_seqno: 1779114408146776 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:53.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.215381 23489 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:53.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.197930 23593 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff7a0965b1d847f6a8670f1caecb7872. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:53.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.216418 23593 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: This master's current role is: LEADER
14:26:53.219 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:53.219 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:53.219 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:53.220 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.220 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.220 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.220 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:53.221 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26709), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [132ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [133ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [133ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [252ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [264ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [296ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [298ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [342ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [382ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [902ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [3780ms] refreshing cache from master, [3780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3782ms] too many traces: truncated at 100 traces, deferred=Deferred@441531095(state=PENDING, result=null, callback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444), errback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444)))
14:26:53.222 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
14:26:53.222 [WARN - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26709), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [132ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [133ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [133ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [252ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [264ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [296ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [298ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [342ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [382ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [902ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [3780ms] refreshing cache from master, [3780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3782ms] too many traces: truncated at 100 traces, deferred=Deferred@441531095(state=PENDING, result=null, callback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444), errback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.223 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7).
14:26:53.225 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#7 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
14:26:53.227 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26709), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [132ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [133ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [133ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [252ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [264ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [296ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [297ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [298ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [342ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [382ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [521ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [562ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [901ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [902ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [3780ms] refreshing cache from master, [3780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [3781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [3782ms] too many traces: truncated at 100 traces, deferred=Deferred@441531095(state=PENDING, result=null, callback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444), errback=(continuation of Deferred@991839609 after retry RPC after error@1333721536) -> (continuation of Deferred@1796311345 after retry RPC after error@2013630726) -> (continuation of Deferred@838412018 after retry RPC after error@166820340) -> (continuation of Deferred@1859002874 after retry RPC after error@974585988) -> (continuation of Deferred@1117880194 after retry RPC after error@1075679483) -> (continuation of Deferred@1606662387 after retry RPC after error@1565692079) -> (continuation of Deferred@340175336 after retry RPC after error@955283923) -> (continuation of Deferred@2050382366 after retry RPC after error@858290719) -> (continuation of Deferred@302029947 after retry RPC after error@696598793) -> (continuation of Deferred@1630214285 after retry RPC after error@295927349) -> (continuation of Deferred@123128638 after retry RPC after error@72900564) -> (continuation of Deferred@1024376994 after retry RPC after error@936793056) -> (continuation of Deferred@115892511 after retry RPC after error@1082669289) -> (continuation of Deferred@189332362 after retry RPC after error@243589200) -> (continuation of Deferred@1260488710 after retry RPC after error@1257221883) -> (continuation of Deferred@104306823 after retry RPC after error@790134385) -> (continuation of Deferred@1757327916 after retry RPC after error@1594970550) -> (continuation of Deferred@1700268403 after retry RPC after error@165611615) -> (continuation of Deferred@342746266 after retry RPC after error@1092918080) -> (continuation of Deferred@1678901638 after retry RPC after error@368996523) -> (continuation of Deferred@1858871226 after retry RPC after error@198666168) -> (continuation of Deferred@2143111541 after retry RPC after error@429921537) -> (continuation of Deferred@387967040 after retry RPC after error@658880444)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.228 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:53.229 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#7) of source Source: KuduSource.
14:26:53.229 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
14:26:53.230 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RUNNING to RESTARTING.
14:26:53.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.243988 23612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:26:53.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.285604 23612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:26:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.259652 23339 master_runner.cc:187] Error getting master registration for 127.22.199.253:33945: OK, instance_id { permanent_uuid: "62685b9971d649a097e3481849cab2d0" instance_seqno: 1779114410196887 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:26:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.314772 23339 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:26:53.321 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:53.321 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:53.321 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:53.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:53.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:53.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:53.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:53.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:53.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:53.322 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:53.322 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:53.322 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:53.322 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:53.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.328037 23547 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [term 1 FOLLOWER]: Refusing update from remote peer ff7a0965b1d847f6a8670f1caecb7872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:53.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.330606 23593 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:26:53.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:53.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:53.367 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:53.367 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.368 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.368 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:53.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.374650 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff7a0965b1d847f6a8670f1caecb7872. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:53.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.375391 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: This master's current role is: FOLLOWER
14:26:53.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.385677 23615 mvcc.cc:204] Tried to move back new op lower bound from 7287252636973486080 to 7287252636261814272. Current Snapshot: MvccSnapshot[applied={T|T < 7287252636973486080}]
14:26:53.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:53.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:53.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:53.397 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.397 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.398 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.398 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.398 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:53.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.424315 23593 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:53.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.424996 23593 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: This master's current role is: LEADER
14:26:53.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.428934 23612 catalog_manager.cc:1383] Generated new cluster ID: 9a9f744b8cec4071b99385948ce7c7e7
14:26:53.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.429230 23612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:26:53.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.432056 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:53.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.432828 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1 [sys.catalog]: This master's current role is: FOLLOWER
14:26:53.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.469892 23612 catalog_manager.cc:1406] Generated new certificate authority record
14:26:53.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.477802 23612 catalog_manager.cc:1540] Loading token signing keys...
14:26:53.517 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:53.517 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:53.517 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:53.518 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.518 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.518 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:53.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:53.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:53.518 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:53.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.536736 23612 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872: Generated new TSK 0
14:26:53.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.538002 23612 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:26:53.556 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:53.557 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:53.557 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:53.558 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.558 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.558 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:53.558 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.558 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.558 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:53.559 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.559 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.559 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:53.559 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:53.560 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [194ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [259ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [260ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [263ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [300ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [340ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [341ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [402ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [601ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [961ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1740ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1742ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2022ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4621ms] too many traces: truncated at 100 traces, deferred=Deferred@2138169741(state=PENDING, result=null, callback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052), errback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052)))
14:26:53.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
14:26:53.561 [WARN - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [194ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [259ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [260ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [263ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [300ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [340ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [341ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [402ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [601ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [961ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1740ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1742ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2022ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4621ms] too many traces: truncated at 100 traces, deferred=Deferred@2138169741(state=PENDING, result=null, callback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052), errback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
14:26:53.563 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#7 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
14:26:53.565 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED on 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [194ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [222ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [224ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [259ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [260ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [263ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [300ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [301ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [301ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [340ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [341ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [402ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [402ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [521ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [522ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [601ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [601ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [961ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [961ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1740ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1742ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2020ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2022ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4621ms] too many traces: truncated at 100 traces, deferred=Deferred@2138169741(state=PENDING, result=null, callback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052), errback=(continuation of Deferred@885012019 after retry RPC after error@2136601009) -> (continuation of Deferred@791863874 after retry RPC after error@1606353824) -> (continuation of Deferred@1794889674 after retry RPC after error@1520400221) -> (continuation of Deferred@1653063358 after retry RPC after error@1166148429) -> (continuation of Deferred@1903413680 after retry RPC after error@1350004060) -> (continuation of Deferred@265964450 after retry RPC after error@1511504255) -> (continuation of Deferred@893830596 after retry RPC after error@1580225469) -> (continuation of Deferred@57312386 after retry RPC after error@1683032529) -> (continuation of Deferred@1731889274 after retry RPC after error@994808475) -> (continuation of Deferred@1825726436 after retry RPC after error@2214958) -> (continuation of Deferred@871103752 after retry RPC after error@1423142564) -> (continuation of Deferred@704652965 after retry RPC after error@617537399) -> (continuation of Deferred@1218540891 after retry RPC after error@122193061) -> (continuation of Deferred@743878631 after retry RPC after error@2125588605) -> (continuation of Deferred@1031356765 after retry RPC after error@2128058363) -> (continuation of Deferred@1743201873 after retry RPC after error@384096464) -> (continuation of Deferred@1642074360 after retry RPC after error@592063344) -> (continuation of Deferred@2109822182 after retry RPC after error@1297293782) -> (continuation of Deferred@752193364 after retry RPC after error@1588998165) -> (continuation of Deferred@698825025 after retry RPC after error@2108616754) -> (continuation of Deferred@2105638908 after retry RPC after error@307809985) -> (continuation of Deferred@36016378 after retry RPC after error@134275052)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.10.60.60:46387
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.566 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:53.566 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
14:26:53.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#7) of source Source: KuduSource.
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:53.569252 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/logs
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data/info.pb
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.193:0
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.193
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.193
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:53.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:53.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114413658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:53.668 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:26:53.669 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
14:26:53.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:53.707 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:53.707 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:53.707 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:53.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.708 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.708 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.708 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.709 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.709 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:53.740 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:53.741 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:53.741 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:53.741 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:53.741 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:53.741 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:53.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:53.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:53.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:53.743 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:53.743 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:53.743 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:53.743 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:53.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:53.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:53.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:53.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.949 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:53.950 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27378), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [265ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [267ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [311ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [311ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [354ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [364ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [382ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [382ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [401ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [420ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [421ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [482ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [742ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1461ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3141ms] too many traces: truncated at 100 traces, deferred=Deferred@1275668350(state=PENDING, result=null, callback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209), errback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209)))
14:26:53.950 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:53.950 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:53.951 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:53.951 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27378), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [265ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [267ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [311ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [311ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [354ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [364ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [382ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [382ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [401ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [420ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [421ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [482ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [742ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1461ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3141ms] too many traces: truncated at 100 traces, deferred=Deferred@1275668350(state=PENDING, result=null, callback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209), errback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27378), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [265ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [267ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [311ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [311ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [354ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [364ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [382ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [382ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [401ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [420ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [421ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [482ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [742ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1461ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3141ms] too many traces: truncated at 100 traces, deferred=Deferred@1275668350(state=PENDING, result=null, callback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209), errback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.951 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.955 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27378), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [265ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [267ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [311ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [311ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [354ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [364ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [382ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [382ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [401ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [420ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [421ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [482ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [742ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1461ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3141ms] too many traces: truncated at 100 traces, deferred=Deferred@1275668350(state=PENDING, result=null, callback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209), errback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27378), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [265ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [266ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [267ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [267ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [309ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [311ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [311ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [354ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [364ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [364ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [382ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [382ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [401ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [401ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [420ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [421ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [421ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [482ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [482ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [541ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [542ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [741ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [742ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [801ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [801ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [1461ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.188:36123: Network error: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.189:37257: Network error: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257, [2601ms] Sub RPC ConnectToMaster: received response from server master-127.9.135.190:41023: Network error: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.188:36123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.189:37257, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.135.190:41023, [3141ms] too many traces: truncated at 100 traces, deferred=Deferred@1275668350(state=PENDING, result=null, callback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209), errback=(continuation of Deferred@413852346 after retry RPC after error@1867967034) -> (continuation of Deferred@827689395 after retry RPC after error@887253552) -> (continuation of Deferred@2073227556 after retry RPC after error@600687446) -> (continuation of Deferred@1044958861 after retry RPC after error@425492638) -> (continuation of Deferred@1974159680 after retry RPC after error@942797776) -> (continuation of Deferred@1089830653 after retry RPC after error@1028677133) -> (continuation of Deferred@304013742 after retry RPC after error@629555022) -> (continuation of Deferred@1315942293 after retry RPC after error@1911562339) -> (continuation of Deferred@335985762 after retry RPC after error@7245283) -> (continuation of Deferred@869177724 after retry RPC after error@1129137246) -> (continuation of Deferred@1653151225 after retry RPC after error@385654238) -> (continuation of Deferred@1363079940 after retry RPC after error@2029527753) -> (continuation of Deferred@1383384818 after retry RPC after error@538227471) -> (continuation of Deferred@102023898 after retry RPC after error@1069766331) -> (continuation of Deferred@1265915111 after retry RPC after error@1316821581) -> (continuation of Deferred@1851724618 after retry RPC after error@1267529396) -> (continuation of Deferred@582369358 after retry RPC after error@71272743) -> (continuation of Deferred@317464489 after retry RPC after error@1056530966) -> (continuation of Deferred@777908663 after retry RPC after error@1448289258) -> (continuation of Deferred@615546846 after retry RPC after error@1361854604) -> (continuation of Deferred@280875863 after retry RPC after error@1606348505) -> (continuation of Deferred@2018976895 after retry RPC after error@1263285209)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.135.190:41023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:53.956 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:53.956 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#7) of source Source: KuduSource.
14:26:53.951 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.956 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:53.958 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to CANCELING.
14:26:53.958 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
14:26:53.958 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to CANCELING.
14:26:53.959 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
14:26:53.959 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#7) of source Source: KuduSource.
14:26:53.960 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to CANCELING.
14:26:53.962 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:53.962 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:53.962 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:53.962 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.962 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.963 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:53.963 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.963 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.963 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:53.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:53.963 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:53.966 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:53.966 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:53.966 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:53.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.967 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.967 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:53.970 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
14:26:53.970 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CANCELING to CANCELED.
14:26:53.971 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
14:26:53.985 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
14:26:53.985 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to CANCELING.
14:26:53.985 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
14:26:53.987 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:53.987 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:53.987 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:53.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.987 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.987 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:53.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:53.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:53.987 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:53.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
14:26:53.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CANCELING to CANCELED.
14:26:53.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#7 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
14:26:53.999 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#7 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
14:26:53.999 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#7 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
14:26:53.999 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CANCELING to CANCELED.
14:26:54.000 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CANCELING to CANCELED.
14:26:54.001 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:54.001 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job d754db15cc0c9bfa72479ca905ecb22a
14:26:54.006 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.006 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.006 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.006 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.007 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.027 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.028 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.046 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.046 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.046 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.047 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.074431 23621 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:54.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.075239 23621 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:54.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.075891 23621 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:54.079 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:54.079 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:54.079 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:54.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:54.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:54.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:54.080 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:54.080 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:54.080 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:54.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:54.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:54.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:54.080 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:54.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.126 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.126 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.126 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.127 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.127 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.135804 23621 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:54.139 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2c28d6d49adcc0d598680955c9f9304b) switched from state RESTARTING to RUNNING.
14:26:54.140 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2c28d6d49adcc0d598680955c9f9304b from Checkpoint 69 @ 1779114320041 for 2c28d6d49adcc0d598680955c9f9304b located at file:/tmp/junit9781152734840635638/checkpoints/2c28d6d49adcc0d598680955c9f9304b/chk-69.
14:26:54.140 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:26:54.141 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
14:26:54.141 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
14:26:54.141 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a7ca8bbb-4b0d-418d-a45d-2b83604b848e @ 127.0.0.1 (dataPort=-1) with allocation id 8e9538df5a0dfbedb16829666ce7ddc2
14:26:54.142 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 69 for source Source: KuduSource to checkpoint.
14:26:54.142 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 2c28d6d49adcc0d598680955c9f9304b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:54.143 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 8e9538df5a0dfbedb16829666ce7ddc2.
14:26:54.144 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 8e9538df5a0dfbedb16829666ce7ddc2.
14:26:54.147 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.147 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.147 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.148 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.137112 23621 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.199.193
14:26:54.153 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
14:26:54.153 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
14:26:54.154 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65afa3d5
14:26:54.154 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:54.155 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9781152734840635638/checkpoints")
14:26:54.156 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:26:54.156 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (828bca02842c6378884ce240926f0f48_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
14:26:54.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114414158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:54.166 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
14:26:54.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
14:26:54.169 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7cae254c
14:26:54.174 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:54.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.178 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.184653 23605 catalog_manager.cc:1295] Loaded cluster ID: 9a9f744b8cec4071b99385948ce7c7e7
14:26:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.184911 23605 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: loading cluster ID for follower catalog manager: success
14:26:54.190 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.192 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.192 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.192 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.192 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.193 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.199 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.199 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.200 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.200 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.201 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.201 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.201 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.201 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.219 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.233732 23605 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: acquiring CA information for follower catalog manager: success
14:26:54.236 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.251658 23621 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.193:0
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data/info.pb
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.193
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.193
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/logs
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.253365 23621 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:54.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.255456 23621 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:54.262 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.262 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.268 [DEBUG - pool-398-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [5ms] received response from server master-127.19.148.60:37365: OK, deferred=null) with no deferred attached!
14:26:54.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.277 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.287 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:54.287 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:54.287 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:54.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.288 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:54.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.289644 23646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:54.298 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.299 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.299 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.299 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.299 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.299 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.299 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.299 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.319 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.319 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.319 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.319 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.319 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.319 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.320 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.320 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.328933 23605 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 81416f1bc0ac4417a0f9fcd3706c8af1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:54.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.360 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.378 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.379 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.379 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.379 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.387 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.387 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.387 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.387 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.388 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.398 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.398 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.398 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.398 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.399 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.399 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.399 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.399 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.399 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.399 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.399 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.399 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.399 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.459 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:54.459 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:54.459 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:54.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:54.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:54.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:54.460 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:54.474 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:54.475 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:54.475 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:54.475 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.476 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:54.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27901), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [237ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [241ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [245ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [246ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [269ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [274ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [283ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [306ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [307ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [313ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [313ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [313ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [321ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [322ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [341ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [341ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [361ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [362ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [382ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [382ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [482ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [741ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [741ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [742ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [742ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [761ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1281ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1481ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [4540ms] refreshing cache from master, [4541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [4541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [4541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [4542ms] too many traces: truncated at 100 traces, deferred=Deferred@1431945362(state=PENDING, result=null, callback=(continuation of Deferred@278048647 after retry RPC after error@1497264966) -> (continuation of Deferred@815333660 after retry RPC after error@727653069) -> (continuation of Deferred@783574710 after retry RPC after error@70943845) -> (continuation of Deferred@2094265375 after retry RPC after error@797507642) -> (continuation of Deferred@579158699 after retry RPC after error@1917645618) -> (continuation of Deferred@299668072 after retry RPC after error@1991493817) -> (continuation of Deferred@2116771038 after retry RPC after error@1802237258) -> (continuation of Deferred@517039517 after retry RPC after error@1984921854) -> (continuation of Deferred@1378287429 after retry RPC after error@1725141486) -> (continuation of Deferred@1933307172 after retry RPC after error@2046417869) -> (continuation of Deferred@474009440 after retry RPC after error@1726374375) -> (continuation of Deferred@1243149010 after retry RPC after error@2097709039) -> (continuation of Deferred@1739166945 after retry RPC after error@840247466) -> (continuation of Deferred@1066844760 after retry RPC after error@31405378) -> (continuation of Deferred@721073924 after retry RPC after error@825330313) -> (continuation of Deferred@943459061 after retry RPC after error@1076972949) -> (continuation of Deferred@1057783808 after retry RPC after error@47460522) -> (continuation of Deferred@1525152167 after retry RPC after error@284183179) -> (continuation of Deferred@1260897301 after retry RPC after error@1758850235) -> (continuation of Deferred@228199111 after retry RPC after error@531414509) -> (continuation of Deferred@1784595809 after retry RPC after error@757681317) -> (continuation of Deferred@1882761205 after retry RPC after error@176242634) -> (continuation of Deferred@375952950 after retry RPC after error@1908653114) -> (continuation of Deferred@1148300024 after retry RPC after error@1200468691), errback=(continuation of Deferred@278048647 after retry RPC after error@1497264966) -> (continuation of Deferred@815333660 after retry RPC after error@727653069) -> (continuation of Deferred@783574710 after retry RPC after error@70943845) -> (continuation of Deferred@2094265375 after retry RPC after error@797507642) -> (continuation of Deferred@579158699 after retry RPC after error@1917645618) -> (continuation of Deferred@299668072 after retry RPC after error@1991493817) -> (continuation of Deferred@2116771038 after retry RPC after error@1802237258) -> (continuation of Deferred@517039517 after retry RPC after error@1984921854) -> (continuation of Deferred@1378287429 after retry RPC after error@1725141486) -> (continuation of Deferred@1933307172 after retry RPC after error@2046417869) -> (continuation of Deferred@474009440 after retry RPC after error@1726374375) -> (continuation of Deferred@1243149010 after retry RPC after error@2097709039) -> (continuation of Deferred@1739166945 after retry RPC after error@840247466) -> (continuation of Deferred@1066844760 after retry RPC after error@31405378) -> (continuation of Deferred@721073924 after retry RPC after error@825330313) -> (continuation of Deferred@943459061 after retry RPC after error@1076972949) -> (continuation of Deferred@1057783808 after retry RPC after error@47460522) -> (continuation of Deferred@1525152167 after retry RPC after error@284183179) -> (continuation of Deferred@1260897301 after retry RPC after error@1758850235) -> (continuation of Deferred@228199111 after retry RPC after error@531414509) -> (continuation of Deferred@1784595809 after retry RPC after error@757681317) -> (continuation of Deferred@1882761205 after retry RPC after error@176242634) -> (continuation of Deferred@375952950 after retry RPC after error@1908653114) -> (continuation of Deferred@1148300024 after retry RPC after error@1200468691)))
14:26:54.487 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:54.487 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:54.487 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:54.487 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.487 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.488 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:54.508 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:54.508 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:54.508 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:54.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.509 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.509 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.509 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:54.509 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.509 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:54.509 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.509 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.509 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:54.509 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:54.558 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.558 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.559 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.560 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.560 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.560 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.560 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.560 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.580 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:54.580 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:54.580 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:54.581 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.581 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.581 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:54.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:54.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:54.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:54.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.635 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:54.635 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:54.635 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:54.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:54.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:54.636 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.636 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.636 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:54.636 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:54.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114414658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:54.667 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:54.669 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
14:26:54.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.723436 23487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } attempt: 8
14:26:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.730589 23360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.199.253:33945 timed out after 1.641s (SENT) [suppressed 13 similar messages]
14:26:54.879 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:54.879 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:54.879 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:54.880 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.880 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.880 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:54.880 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.880 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.880 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:54.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:54.880 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:54.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:54.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:54.946789 23487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: Bootstrap starting.
14:26:55.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:55.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:55.073 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:55.074 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:55.074 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:55.074 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:55.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:55.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:55.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:55.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:55.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:55.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:55.074 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:55.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.106652 23487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: Neither blocks nor log segments found. Creating new log.
14:26:55.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114415158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:55.168 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
14:26:55.169 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
14:26:55.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.198446 23487 log.cc:826] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: Log is configured to *not* fsync() on all Append() calls
14:26:55.286 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:55.286 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:55.287 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:55.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.287 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:55.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.355389 23487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: No bootstrap required, opened a new log
14:26:55.398 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:55.398 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:55.398 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:55.398 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.399 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.399 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.399 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.399 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.399 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.399 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.399 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.399 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:55.419 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:55.419 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:55.419 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:55.420 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:55.420 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:55.420 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:55.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:55.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:55.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:55.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:55.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:55.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:55.421 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:55.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.555 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:55.555 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:55.555 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:55.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:55.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:55.557 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.557 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.557 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:55.557 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:55.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.594 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:55.594 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:55.595 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:55.595 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.595 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.595 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.595 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.596 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.596 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.596 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:55.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.659 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114415659 for job 4459c5bc8e668403214dd967e9f85899.
14:26:55.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
14:26:55.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
14:26:55.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.840222 23487 raft_consensus.cc:359] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:55.843 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:55.843 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:55.843 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:55.843 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.843 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.843 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.843 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.843 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:55.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.843 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:55.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:55.844 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.841130 23487 raft_consensus.cc:385] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:26:55.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.841428 23487 raft_consensus.cc:740] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62685b9971d649a097e3481849cab2d0, State: Initialized, Role: FOLLOWER
14:26:55.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.842360 23487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } }
14:26:55.847 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:55.847 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:55.847 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:55.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.847 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.847 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.847 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:55.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:55.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.848 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:55.848 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:55.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.849501 23657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:55.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.852821 23657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: This master's current role is: FOLLOWER
14:26:55.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.857088 23487 sys_catalog.cc:565] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: configured and running, proceeding with master startup.
14:26:55.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.857251 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62685b9971d649a097e3481849cab2d0" is_pre_election: true
14:26:55.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.858021 23462 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff7a0965b1d847f6a8670f1caecb7872 in term 0.
14:26:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.858578 23462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49704 (request call id 1) took 2769 ms (client timeout 2035 ms). Trace:
14:26:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.859045 23462 rpcz_store.cc:269] 0518 14:26:53.089067 (+     0us) service_pool.cc:167] Inserting onto call queue
14:26:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:53.089263 (+   196us) service_pool.cc:224] Handling call
14:26:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.858501 (+2769238us) inbound_call.cc:177] Queueing success response
14:26:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:26:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.860857 23460 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 0 FOLLOWER]: Advancing to term 1
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.863584 23459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62685b9971d649a097e3481849cab2d0"
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.864557 23459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49704 (request call id 5) took 1124 ms. Trace:
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.864938 23459 rpcz_store.cc:276] 0518 14:26:54.740168 (+     0us) service_pool.cc:167] Inserting onto call queue
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:54.741500 (+  1332us) service_pool.cc:224] Handling call
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.864495 (+1122995us) inbound_call.cc:177] Queueing success response
14:26:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.867480 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62685b9971d649a097e3481849cab2d0" is_pre_election: true
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.868577 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff7a0965b1d847f6a8670f1caecb7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62685b9971d649a097e3481849cab2d0"
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.869300 23461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49704 (request call id 2) took 2777 ms (client timeout 1641 ms). Trace:
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.869621 23461 rpcz_store.cc:269] 0518 14:26:53.091678 (+     0us) service_pool.cc:167] Inserting onto call queue
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:53.091953 (+   275us) service_pool.cc:224] Handling call
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.869236 (+2777283us) inbound_call.cc:177] Queueing success response
14:26:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:26:55.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.877040 23460 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [term 1 FOLLOWER]: Refusing update from remote peer ff7a0965b1d847f6a8670f1caecb7872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:26:55.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.877923 23460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49704 (request call id 4) took 2548 ms. Trace:
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.878408 23460 rpcz_store.cc:276] 0518 14:26:53.329707 (+     0us) service_pool.cc:167] Inserting onto call queue
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:53.329867 (+   160us) service_pool.cc:224] Handling call
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.860535 (+2530668us) raft_consensus.cc:1471] Updating replica for 0 ops
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.877510 (+ 16975us) raft_consensus.cc:1697] Filling consensus response to leader.
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 14:26:55.877851 (+   341us) inbound_call.cc:177] Queueing success response
14:26:55.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:26:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.880420 23651 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:26:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.897444 23441 tablet.cc:2404] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:26:55.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.935163 23657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff7a0965b1d847f6a8670f1caecb7872. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.935961 23657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: This master's current role is: FOLLOWER
14:26:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.937379 23666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.938217 23666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0 [sys.catalog]: This master's current role is: FOLLOWER
14:26:55.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:55.957732 23673 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:26:56.080 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:56.081 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:56.081 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:56.088 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:56.088 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:56.088 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:56.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:56.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:56.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:56.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:56.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:56.089 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:56.090 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:56.096 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.158 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114416158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:56.167 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:26:56.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
14:26:56.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.267 [DEBUG - pool-398-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [8ms] received response from server master-127.19.148.60:37365: OK, deferred=null) with no deferred attached!
14:26:56.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.308344 23651 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff7a0965b1d847f6a8670f1caecb7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff7a0965b1d847f6a8670f1caecb7872" member_type: VOTER last_known_addr { host: "127.22.199.254" port: 42535 } } peers { permanent_uuid: "62685b9971d649a097e3481849cab2d0" member_type: VOTER last_known_addr { host: "127.22.199.253" port: 33945 } } peers { permanent_uuid: "81416f1bc0ac4417a0f9fcd3706c8af1" member_type: VOTER last_known_addr { host: "127.22.199.252" port: 43961 } } }
14:26:56.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.310429 23651 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7a0965b1d847f6a8670f1caecb7872 [sys.catalog]: This master's current role is: LEADER
14:26:56.340 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:56.341 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:56.341 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:56.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.342 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.342 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.342 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.342 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:56.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:56.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:56.441 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:56.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.442 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:56.461 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:56.461 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:56.461 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:56.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:56.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:56.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:56.462 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:56.479 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:26:56.479 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:26:56.479 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:26:56.480 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.480 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:26:56.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:26:56.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:26:56.480 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:26:56.481 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29909), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [78ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [83ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [84ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [351ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [352ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [352ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [357ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [357ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [388ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [388ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [388ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [400ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [401ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [401ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [421ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [422ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [464ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [464ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [465ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [465ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [501ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [502ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [502ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [541ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [543ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [543ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [543ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [641ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [642ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [642ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [642ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1101ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1102ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [1462ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2020ms] refreshing cache from master, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [2020ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.62:34681: Network error: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.61:42317: Network error: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.10.60.60:46387: Network error: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [2021ms] delaying RPC due to: Service unavailable: Master config (127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387, [5481ms] refreshing cache from master, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.62:34681, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.61:42317, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.60.60:46387, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1196061138(state=PENDING, result=null, callback=(continuation of Deferred@1334118344 after retry RPC after error@1601256519) -> (continuation of Deferred@766967533 after retry RPC after error@963042920) -> (continuation of Deferred@1580869067 after retry RPC after error@142584143) -> (continuation of Deferred@312770363 after retry RPC after error@490628761) -> (continuation of Deferred@304422024 after retry RPC after error@1743120978) -> (continuation of Deferred@1443437618 after retry RPC after error@946709188) -> (continuation of Deferred@35006493 after retry RPC after error@1256842615) -> (continuation of Deferred@1419741332 after retry RPC after error@20015937) -> (continuation of Deferred@852819386 after retry RPC after error@924021962) -> (continuation of Deferred@534811028 after retry RPC after error@352422474) -> (continuation of Deferred@2989181 after retry RPC after error@749997462) -> (continuation of Deferred@927159717 after retry RPC after error@772393693) -> (continuation of Deferred@1118528789 after retry RPC after error@1325340779) -> (continuation of Deferred@1673298540 after retry RPC after error@50586596) -> (continuation of Deferred@437890396 after retry RPC after error@747881012) -> (continuation of Deferred@725322280 after retry RPC after error@926634088) -> (continuation of Deferred@1612671134 after retry RPC after error@1378845899) -> (continuation of Deferred@632438380 after retry RPC after error@1223135906) -> (continuation of Deferred@1395083448 after retry RPC after error@2105579467) -> (continuation of Deferred@1232443209 after retry RPC after error@1039363655) -> (continuation of Deferred@1425576905 after retry RPC after error@759134290) -> (continuation of Deferred@1209363811 after retry RPC after error@1857201008) -> (continuation of Deferred@2126775220 after retry RPC after error@686754262) -> (continuation of Deferred@1274152925 after retry RPC after error@807437552) -> (continuation of Deferred@1848113379 after retry RPC after error@1054276936) -> (continuation of Deferred@1707198880 after retry RPC after error@1374865132), errback=(continuation of Deferred@1334118344 after retry RPC after error@1601256519) -> (continuation of Deferred@766967533 after retry RPC after error@963042920) -> (continuation of Deferred@1580869067 after retry RPC after error@142584143) -> (continuation of Deferred@312770363 after retry RPC after error@490628761) -> (continuation of Deferred@304422024 after retry RPC after error@1743120978) -> (continuation of Deferred@1443437618 after retry RPC after error@946709188) -> (continuation of Deferred@35006493 after retry RPC after error@1256842615) -> (continuation of Deferred@1419741332 after retry RPC after error@20015937) -> (continuation of Deferred@852819386 after retry RPC after error@924021962) -> (continuation of Deferred@534811028 after retry RPC after error@352422474) -> (continuation of Deferred@2989181 after retry RPC after error@749997462) -> (continuation of Deferred@927159717 after retry RPC after error@772393693) -> (continuation of Deferred@1118528789 after retry RPC after error@1325340779) -> (continuation of Deferred@1673298540 after retry RPC after error@50586596) -> (continuation of Deferred@437890396 after retry RPC after error@747881012) -> (continuation of Deferred@725322280 after retry RPC after error@926634088) -> (continuation of Deferred@1612671134 after retry RPC after error@1378845899) -> (continuation of Deferred@632438380 after retry RPC after error@1223135906) -> (continuation of Deferred@1395083448 after retry RPC after error@2105579467) -> (continuation of Deferred@1232443209 after retry RPC after error@1039363655) -> (continuation of Deferred@1425576905 after retry RPC after error@759134290) -> (continuation of Deferred@1209363811 after retry RPC after error@1857201008) -> (continuation of Deferred@2126775220 after retry RPC after error@686754262) -> (continuation of Deferred@1274152925 after retry RPC after error@807437552) -> (continuation of Deferred@1848113379 after retry RPC after error@1054276936) -> (continuation of Deferred@1707198880 after retry RPC after error@1374865132)))
14:26:56.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.628 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:56.628 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:56.628 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:56.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:56.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:56.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:56.629 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:56.629 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:56.629 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:56.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:56.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:56.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:56.629 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:56.658 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:56.658 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:56.658 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:56.658 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114416658 for job 4459c5bc8e668403214dd967e9f85899.
14:26:56.659 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.659 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.659 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.659 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.659 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.659 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.660 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.660 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.660 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.660 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:56.673 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:26:56.674 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
14:26:56.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:55.684818 23645 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 23621
14:26:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:56.731917 23621 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.401s	user 0.777s	sys 1.278s
14:26:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:54.332705 23647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:56.732311 23621 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.402s	user 0.777s	sys 1.278s
14:26:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.740509 23621 server_base.cc:1061] running on GCE node
14:26:56.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:56.741852 23678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:56.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.743314 23621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:56.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.745810 23621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:56.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.747275 23621 hybrid_clock.cc:648] HybridClock initialized: now 1779114416747247 us; error 94 us; skew 500 ppm
14:26:56.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.748380 23621 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:56.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.757329 23621 webserver.cc:533] Webserver started at http://127.22.199.193:43577/ using document root <none> and password file <none>
14:26:56.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.759390 23621 fs_manager.cc:362] Metadata directory not provided
14:26:56.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.759678 23621 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:26:56.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.760257 23621 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:26:56.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.766615 23621 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data/instance:
14:26:56.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5615ae745041414ab387d8f10a17a5cc"
14:26:56.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:56 on dist-test-slave-1n46"
14:26:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.768119 23621 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal/instance:
14:26:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5615ae745041414ab387d8f10a17a5cc"
14:26:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:56 on dist-test-slave-1n46"
14:26:56.792 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:56.792 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:56.793 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:56.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:56.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:56.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:56.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:56.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:56.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:56.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:56.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:56.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:56.794 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:56.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.800800 23621 fs_manager.cc:696] Time spent creating directory manager: real 0.032s	user 0.013s	sys 0.016s
14:26:56.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.824098 23684 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:26:56.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.827015 23621 fs_manager.cc:730] Time spent opening block manager: real 0.022s	user 0.004s	sys 0.016s
14:26:56.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.827390 23621 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal
14:26:56.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5615ae745041414ab387d8f10a17a5cc"
14:26:56.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:56 on dist-test-slave-1n46"
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.827849 23621 fs_report.cc:389] FS layout report
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data/data
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:26:56.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:26:56.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.898810 23621 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:26:56.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.900568 23621 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:26:56.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.901077 23621 kserver.cc:163] Server-wide thread pool size limit: 3276
14:26:56.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.904755 23621 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:26:56.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.910496 23621 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:26:56.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.910735 23621 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:26:56.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.911064 23621 ts_tablet_manager.cc:616] Registered 0 tablets
14:26:56.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.911283 23621 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:26:56.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:56.939 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:56.939 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:56.940 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:56.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:56.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:56.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:56.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:56.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.985423 23673 catalog_manager.cc:1295] Loaded cluster ID: 9a9f744b8cec4071b99385948ce7c7e7
14:26:56.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.985945 23673 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: loading cluster ID for follower catalog manager: success
14:26:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:56.997539 23673 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: acquiring CA information for follower catalog manager: success
14:26:57.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.006901 23673 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 62685b9971d649a097e3481849cab2d0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:26:57.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.159 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114417158 for job 4459c5bc8e668403214dd967e9f85899.
14:26:57.170 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job 4459c5bc8e668403214dd967e9f85899 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
14:26:57.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
14:26:57.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.187 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:57.187 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:57.187 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:57.188 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.188 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.188 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.188 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.189 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:57.207 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.208 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.208 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.208 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.208 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.209 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.209 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.209 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.209 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.209 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [1ms] received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [3ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [4ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [5ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [25ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [84ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [105ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [185ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [284ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [364ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] refreshing cache from master, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [564ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [725ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2003ms] refreshing cache from master, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [2004ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [4884ms] refreshing cache from master, [4884ms] too many traces: truncated at 100 traces, deferred=Deferred@370101175(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@30606b9 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481)))
14:26:57.210 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.210 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.210 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.211 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [1ms] received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [3ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [4ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [5ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [25ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [84ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [105ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [185ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [284ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [364ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] refreshing cache from master, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [564ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [725ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2003ms] refreshing cache from master, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [2004ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [4884ms] refreshing cache from master, [4884ms] too many traces: truncated at 100 traces, deferred=Deferred@370101175(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@30606b9 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [1ms] received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [3ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [4ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [5ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [25ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [84ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [105ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [185ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [284ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [364ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] refreshing cache from master, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [564ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [725ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2003ms] refreshing cache from master, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [2004ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [4884ms] refreshing cache from master, [4884ms] too many traces: truncated at 100 traces, deferred=Deferred@370101175(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@30606b9 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.148.61:37523
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:57.212 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.212 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.212 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.212 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.212 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.212 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.212 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.212 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.217 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:57.217 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:57.218 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:57.218 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.218 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.218 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.218 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.218 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.219 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.219 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.219 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.219 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:57.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:57.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:57.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:57.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.228 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.228 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.228 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:57.228 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.229 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.229 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.230 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.231 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [1ms] received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [3ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [4ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [5ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [25ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [84ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [105ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [185ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [284ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [364ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] refreshing cache from master, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [564ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [725ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2003ms] refreshing cache from master, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [2004ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [4884ms] refreshing cache from master, [4884ms] too many traces: truncated at 100 traces, deferred=Deferred@370101175(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@30606b9 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] sending RPC to server master-127.19.148.60:37365, [1ms] received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [3ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [4ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [5ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [5ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [25ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [84ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [84ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [104ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [105ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [185ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] refreshing cache from master, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [284ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [284ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [364ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [364ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] refreshing cache from master, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [564ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [564ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [725ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [725ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2003ms] refreshing cache from master, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.62:34807, [2003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.148.61:37523, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.62:34807: Network error: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.60:37365: Network error: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.19.148.61:37523: Network error: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [2004ms] delaying RPC due to: Service unavailable: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523, [4884ms] refreshing cache from master, [4884ms] too many traces: truncated at 100 traces, deferred=Deferred@370101175(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$225/0x00007f36f832e1c8@30606b9 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1006460178 after retry RPC after error@1073999928) -> (continuation of Deferred@742214012 after retry RPC after error@524132748) -> (continuation of Deferred@1316580020 after retry RPC after error@287621491) -> (continuation of Deferred@1460935810 after retry RPC after error@626517549) -> (continuation of Deferred@545129721 after retry RPC after error@392591068) -> (continuation of Deferred@1617004734 after retry RPC after error@2057141265) -> (continuation of Deferred@706012791 after retry RPC after error@249607551) -> (continuation of Deferred@1646852197 after retry RPC after error@1942257093) -> (continuation of Deferred@2129533588 after retry RPC after error@1965949819) -> (continuation of Deferred@1356871275 after retry RPC after error@1721319) -> (continuation of Deferred@246338506 after retry RPC after error@194919615) -> (continuation of Deferred@1520173257 after retry RPC after error@147551494) -> (continuation of Deferred@1887684438 after retry RPC after error@167933501) -> (continuation of Deferred@807581180 after retry RPC after error@1662162363) -> (continuation of Deferred@231036920 after retry RPC after error@351239139) -> (continuation of Deferred@826782167 after retry RPC after error@1175409929) -> (continuation of Deferred@1632809127 after retry RPC after error@244182797) -> (continuation of Deferred@46677506 after retry RPC after error@1045660751) -> (continuation of Deferred@1248910506 after retry RPC after error@728020846) -> (continuation of Deferred@1746904110 after retry RPC after error@1254892702) -> (continuation of Deferred@102048993 after retry RPC after error@147074186) -> (continuation of Deferred@493868904 after retry RPC after error@908912783) -> (continuation of Deferred@422699143 after retry RPC after error@808988503) -> (continuation of Deferred@1401907887 after retry RPC after error@37132481)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.148.61:37523
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:57.233 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:26:57.233 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4459c5bc8e668403214dd967e9f85899) switched from state RUNNING to RESTARTING.
14:26:57.234 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
14:26:57.234 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:26:57.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:57.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
14:26:57.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:57.235 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
14:26:57.236 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:26:57.236 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
14:26:57.236 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:26:57.237 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
14:26:57.237 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:26:57.248 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.249 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.249 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.251 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.251 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.251 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.252 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.268 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.268 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.268 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.269 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.269 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.269 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.270 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.270 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.270 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.278 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] disconnecting while in state TERMINATED
14:26:57.279 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state TERMINATED
14:26:57.279 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state TERMINATED
14:26:57.279 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state TERMINATED
14:26:57.279 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:57.281 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
14:26:57.282 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:57.282 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:57.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.288 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.290 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.290 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.290 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.311 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:57.311 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
14:26:57.311 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:57.313 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:57.313 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
14:26:57.313 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:57.315 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 53d7c903ee4c473aa5f0b637189c6e7d(127.20.103.65:40757)] disconnecting while in state TERMINATED
14:26:57.315 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 8e2070f9879f4b97aca892de05842e15(127.20.103.66:35167)] disconnecting while in state TERMINATED
14:26:57.315 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state TERMINATED
14:26:57.315 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state TERMINATED
14:26:57.315 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state TERMINATED
14:26:57.315 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:57.316 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:57.316 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:57.316 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
14:26:57.316 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:57.316 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-4
14:26:57.316 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
14:26:57.316 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
14:26:57.318 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state TERMINATED
14:26:57.318 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state TERMINATED
14:26:57.318 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state TERMINATED
14:26:57.318 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] disconnecting while in state TERMINATED
14:26:57.318 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:57.319 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
14:26:57.319 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:57.319 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
14:26:57.322 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
14:26:57.322 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:57.323 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:26:57.323 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
14:26:57.324 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
14:26:57.324 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
14:26:57.325 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:57.329 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.329 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.329 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.330 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.330 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.338 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
14:26:57.339 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:57.340 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:26:57.340 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
14:26:57.341 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
14:26:57.342 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
14:26:57.343 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:57.344 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.20.103.125:34309(127.20.103.125:34309)] disconnecting while in state TERMINATED
14:26:57.344 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.20.103.126:39327(127.20.103.126:39327)] disconnecting while in state TERMINATED
14:26:57.344 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.20.103.124:41795(127.20.103.124:41795)] disconnecting while in state TERMINATED
14:26:57.345 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 50f3e1b9790e4e1381b0fb94571564d6(127.20.103.67:35767)] disconnecting while in state TERMINATED
14:26:57.345 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:57.345 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
14:26:57.345 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
14:26:57.345 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
14:26:57.358 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:26:57.358 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:57.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:26:57.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
14:26:57.363 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
14:26:57.364 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
14:26:57.367 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:57.368 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.368 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.369 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.369 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.369 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.370 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.370 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.370 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.370 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.370 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.370 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.378 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
14:26:57.379 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
14:26:57.379 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:26:57.379 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
14:26:57.380 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
14:26:57.381 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
14:26:57.382 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4459c5bc8e668403214dd967e9f85899
14:26:57.418 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:57.418 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:57.419 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:57.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:57.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:57.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:57.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:57.420 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:57.420 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:57.420 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:57.420 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:57.420 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:57.420 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:57.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.460 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:57.460 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:57.460 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:57.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:57.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:57.462 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:57.462 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:57.467 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.467 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.467 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.468 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.468 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.468 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.468 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.468 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.469 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.469 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.548 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.548 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.548 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.549 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.550 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.550 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.550 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.550 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.584573 23621 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.193:34781
14:26:57.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.584692 23816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.193:34781 every 8 connection(s)
14:26:57.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.588145 23621 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/data/info.pb
14:26:57.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.592730 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23621
14:26:57.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.593454 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-0/wal/instance
14:26:57.605 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.627 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:57.627 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:57.628 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:57.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:57.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:57.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:57.628 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:57.628 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:57.628 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:57.628 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:57.629 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:57.629 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:57.629 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.633448 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/logs
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data/info.pb
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.194:0
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.194
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.194
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:26:57.667 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:57.668 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:57.668 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:57.668 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.668 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.668 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:57.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:57.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:57.669 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:57.675 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:57.675 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:57.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.675 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.675 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.675 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.675 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:57.676 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.676 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.676 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.676 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:57.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.676088 23818 heartbeater.cc:344] Connected to a master server at 127.22.199.253:33945
14:26:57.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.676505 23818 heartbeater.cc:461] Registering TS with master...
14:26:57.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.677762 23818 heartbeater.cc:507] Master 127.22.199.253:33945 requested a full tablet report, sending...
14:26:57.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.680783 23817 heartbeater.cc:344] Connected to a master server at 127.22.199.252:43961
14:26:57.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.681107 23817 heartbeater.cc:461] Registering TS with master...
14:26:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.681573 23452 ts_manager.cc:194] Registered new tserver with Master: 5615ae745041414ab387d8f10a17a5cc (127.22.199.193:34781)
14:26:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.681887 23817 heartbeater.cc:507] Master 127.22.199.252:43961 requested a full tablet report, sending...
14:26:57.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.684969 23537 ts_manager.cc:194] Registered new tserver with Master: 5615ae745041414ab387d8f10a17a5cc (127.22.199.193:34781)
14:26:57.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.689366 23821 heartbeater.cc:344] Connected to a master server at 127.22.199.254:42535
14:26:57.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.689774 23821 heartbeater.cc:461] Registering TS with master...
14:26:57.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.690802 23821 heartbeater.cc:507] Master 127.22.199.254:42535 requested a full tablet report, sending...
14:26:57.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.693167 23373 ts_manager.cc:194] Registered new tserver with Master: 5615ae745041414ab387d8f10a17a5cc (127.22.199.193:34781)
14:26:57.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:57.696206 23373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.199.193:40515
14:26:57.774 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:57.774 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:57.774 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:57.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.775 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:57.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.775 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.775 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:57.775 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:57.775 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:57.919 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:57.919 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:57.919 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:57.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:57.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:57.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:57.920 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:57.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:57.953 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:26:57.953 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:26:57.953 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:26:57.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:57.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:57.954 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:26:57.954 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:57.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:57.954 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:26:57.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:57.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:57.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:26:57.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:26:58.092 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:26:58.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:26:58.100 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:26:58.101 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:58.101 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:58.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:26:58.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:58.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:58.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:26:58.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:58.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:58.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:26:58.101 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:26:58.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.126377 23827 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:26:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.127072 23827 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:26:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.127808 23827 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:26:58.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.185045 23827 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:26:58.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.186666 23827 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.199.194
14:26:58.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:58.247462 23827 tablet_server_runner.cc:78] Tablet server non-default flags:
14:26:58.247 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:26:58.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:26:58.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.194:0
14:26:58.248 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data/info.pb
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.194
14:26:58.248 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.194
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/logs
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:26:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:26:58.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.248 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.249 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.249 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.249 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.249 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:58.249935 23827 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:26:58.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:58.252363 23827 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:26:58.255 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:58.255 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:58.255 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:58.255 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:58.255 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:58.255 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:58.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:58.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:58.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:58.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:58.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:58.256 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:58.256 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:58.276 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4459c5bc8e668403214dd967e9f85899) switched from state RESTARTING to RUNNING.
14:26:58.277 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 4459c5bc8e668403214dd967e9f85899 from Checkpoint 74 @ 1779114417158 for 4459c5bc8e668403214dd967e9f85899 located at file:/tmp/junit12427302695833113137/checkpoints/4459c5bc8e668403214dd967e9f85899/chk-74.
14:26:58.277 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:26:58.278 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:26:58.279 [INFO - Thread-70] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:26:58.279 [DEBUG - Thread-70] (Connection.java:575) [peer master-127.19.148.62:34807(127.19.148.62:34807)] disconnecting while in state TERMINATED
14:26:58.279 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
14:26:58.279 [DEBUG - Thread-70] (Connection.java:575) [peer master-127.19.148.61:37523(127.19.148.61:37523)] disconnecting while in state TERMINATED
14:26:58.279 [DEBUG - Thread-70] (Connection.java:575) [peer master-127.19.148.60:37365(127.19.148.60:37365)] disconnecting while in state TERMINATED
14:26:58.279 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:26:58.280 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
14:26:58.280 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 1fa96300ce4695632939067e99e6b6ed
14:26:58.281 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1fa96300ce4695632939067e99e6b6ed.
14:26:58.281 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
14:26:58.281 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:26:58.282 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 1fa96300ce4695632939067e99e6b6ed.
14:26:58.282 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
14:26:58.282 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 45dbfbea3548d21c9096d14783aaf54e
14:26:58.282 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
14:26:58.282 [DEBUG - Thread-70] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:26:58.283 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:58.283 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
14:26:58.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
14:26:58.283 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
14:26:58.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 98d9e81a5cb56b91733c38b892d9e689
14:26:58.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
14:26:58.283 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:26:58.284 [INFO - Thread-70] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:26:58.284 [INFO - Thread-70] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:26:58.286 [DEBUG - Thread-70] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:58.286 [INFO - Thread-70] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:26:58.294 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4459c5bc8e668403214dd967e9f85899: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:26:58.294 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
14:26:58.294 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 89242725-cc0d-4a24-9517-dcaa815e9eed @ 127.0.0.1 (dataPort=-1) with allocation id 23791360103b5f0d8bad554d0e3cd2c7
14:26:58.296 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 45dbfbea3548d21c9096d14783aaf54e.
14:26:58.297 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 45dbfbea3548d21c9096d14783aaf54e.
14:26:58.298 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
14:26:58.299 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
14:26:58.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.300048 23833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:58.300 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52d2d57c
14:26:58.301 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:58.301 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:58.302 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:26:58.302 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
14:26:58.304 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 98d9e81a5cb56b91733c38b892d9e689.
14:26:58.305 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 98d9e81a5cb56b91733c38b892d9e689.
14:26:58.305 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c6df733
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:26:58.306 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d99f22c
14:26:58.308 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
14:26:58.310 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b14a9c1
14:26:58.311 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:58.313 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 23791360103b5f0d8bad554d0e3cd2c7.
14:26:58.314 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:58.315 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 23791360103b5f0d8bad554d0e3cd2c7.
14:26:58.315 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
14:26:58.315 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
14:26:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c10d3b0
14:26:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:26:58.316 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
14:26:58.319 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2181f8f0
14:26:58.320 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:58.322 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:58.322 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:58.322 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:58.322 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:26:58.329 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.334 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
14:26:58.334 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
14:26:58.335 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31531608
14:26:58.335 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:26:58.335 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12427302695833113137/checkpoints")
14:26:58.335 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:26:58.335 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (06977d9d21d42e3d93dc9439abe67e59_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
14:26:58.340 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.345 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.346 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1cd77d3e
14:26:58.353 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:26:58.354 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.354 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.361 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.362 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.363 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.363 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.363 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.363 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.363 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.363 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.374 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.374 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.374 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.374 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.382 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.389 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.402 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.403 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.404 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.405 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.405 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.405 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.406 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.406 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:26:58.406 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.406 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:26:58.406 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:26:58.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:58.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:58.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:26:58.406 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:58.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:58.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:26:58.407 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:58.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:58.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:26:58.407 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:26:58.415 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.418 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.418 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.418 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.418 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.421 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.426 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.426 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.427 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.427 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.427 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.427 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.427 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.427 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.427 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.428 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.428 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.428 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.428 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.429 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.430 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.434 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.434 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.434 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.434 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.435 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.435 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.435 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.435 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.436 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.436 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.437 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.437 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.437 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.437 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.438 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.438 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.438 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.439 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.439 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.441 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.442 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.446 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.446 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.446 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.446 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.449 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.449 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.449 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.449 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.449 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.450 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.450 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.450 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.450 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.454 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.455 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.455 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.455 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.456 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.457 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.457 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.457 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.459 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.461 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.461 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.462 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.463 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.466 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.466 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.467 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.467 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.467 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.467 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.467 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.467 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.467 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.467 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.469 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.470 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.470 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.471 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.474 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.474 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.475 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.475 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.475 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.475 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.475 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.480 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.481 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.481 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.481 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.481 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.481 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.482 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.482 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.482 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.483 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.483 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.483 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.483 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.484 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.486 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.486 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.486 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.487 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.487 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.487 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.495 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.495 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.495 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.495 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.495 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.495 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.495 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.496 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.496 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.496 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.501 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.501 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.502 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.502 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.502 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.502 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.502 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.502 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.502 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.502 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.502 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.502 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.502 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.502 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.503 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.503 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.503 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.503 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.502 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.503 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.506 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.506 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.506 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.506 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.506 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.506 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.506 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.506 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.506 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.507 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.507 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.509 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.509 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.509 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.509 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.510 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.510 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.510 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.510 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.510 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.510 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.510 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.516 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.516 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.516 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.523 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.523 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.523 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.523 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.523 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.524 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.524 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.524 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.524 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.524 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.524 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.524 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.526 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.526 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.526 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.527 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.527 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.527 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.527 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.529 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.530 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.530 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.530 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.530 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.530 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.532 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:58.532 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:58.532 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:58.532 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:58.532 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:58.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:58.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:58.533 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:58.533 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:58.533 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:58.533 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:58.533 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:58.533 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:58.535 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.535 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.535 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.536 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.536 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.541 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.541 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.541 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.541 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.541 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.541 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.541 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.541 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.541 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.542 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:58.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:58.554 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:58.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.555 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:58.561 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.561 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.561 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.561 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.562 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.562 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.562 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.562 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.562 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.566 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.566 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.566 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.566 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.566 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.566 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.566 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.567 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.567 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.580 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.581 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.581 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.581 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.581 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.581 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.581 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.581 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.581 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.582 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.582 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.582 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.582 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.582 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.582 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.582 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.670 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.670 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.670 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.671 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.671 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.671 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.671 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.674 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.675 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.675 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.675 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.675 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.675 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.675 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.675 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.676 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.676 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.681 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.681 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.681 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.682 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.682 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.682 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.682 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.682 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.682 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.686 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.686 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.687 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.688 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:58.699925 23821 heartbeater.cc:499] Master 127.22.199.254:42535 was elected leader, sending a full tablet report...
14:26:58.701 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.701 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.701 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.702 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.702 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.803 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:58.803 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:58.803 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:58.804 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.804 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.804 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:58.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:58.805 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.805 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.805 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:58.805 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:58.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.815 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.815 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.816 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.816 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.816 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.816 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.820 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:58.820 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:58.820 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:58.821 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:58.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:58.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:58.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:58.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:58.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:58.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:58.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:58.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.822 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.821 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.822 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.822 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.822 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.822 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.823 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.823 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:58.823 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:58.862 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:26:58.862 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:26:58.863 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:26:58.863 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.863 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.863 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.863 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:26:58.863 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.863 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.863 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:26:58.863 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.863 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:26:58.863 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:26:58.869 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.869 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.870 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.870 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.870 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.871 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.871 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.926 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.926 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.927 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.928 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.928 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.928 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:58.961 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:58.975 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:58.975 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:58.975 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:58.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:58.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:58.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:58.977 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.081 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:59.081 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.083 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:59.083 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:59.083 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.083 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.083 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.083 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.083 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.083 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.083 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:59.093 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.146 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.146 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.146 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.146 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.147 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.166 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.166 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.166 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.166 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.166 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.166 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.166 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.166 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.166 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.167 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.167 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.167 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.167 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.310 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.310 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.310 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.311 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.311 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.311 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.312 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.321 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.321 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.321 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.322 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.322 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.322 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.322 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.322 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.322 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.323 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.323 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.323 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.323 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.519 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:26:59.519 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:26:59.519 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:26:59.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:59.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:59.520 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:26:59.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:59.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:59.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:26:59.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:59.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:59.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:26:59.521 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:26:59.555 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.555 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.555 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.556 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.556 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.556 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.557 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:26:59.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:26:59.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:26:59.653 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:59.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:59.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:26:59.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:59.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:59.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:26:59.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:59.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:59.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:26:59.655 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:26:59.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.720 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:59.721 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:59.721 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:59.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.723 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.724 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.724 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.724 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:59.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:26:59.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:26:59.815 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:26:59.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:26:59.816 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.816 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:26:59.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:26:59.816 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:26:59.839 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:59.839 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:59.839 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:59.839 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.839 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.839 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.840 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:26:59.842 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:26:59.842 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:26:59.842 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:26:59.842 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.842 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.842 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:26:59.843 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.843 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.843 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:26:59.843 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:26:59.843 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:26:59.858 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:59.859 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:59.859 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:59.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.860 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.860 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.860 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.860 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:59.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.941 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:26:59.941 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:26:59.941 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:26:59.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:26:59.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:26:59.942 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.942 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.942 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:26:59.942 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:26:59.943 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27948), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [23ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [142ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4661ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1657372674(state=PENDING, result=null, callback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015), errback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015)))
14:26:59.944 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:26:59.944 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27948), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [23ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [142ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4661ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1657372674(state=PENDING, result=null, callback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015), errback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:59.944 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
14:26:59.946 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
14:26:59.948 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27948), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [5ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [5ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [23ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [44ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [44ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [101ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [101ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [142ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [221ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [222ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [222ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [241ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [601ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1443ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2542ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4661ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1657372674(state=PENDING, result=null, callback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015), errback=(continuation of Deferred@1520652012 after retry RPC after error@2100312386) -> (continuation of Deferred@390727463 after retry RPC after error@959269980) -> (continuation of Deferred@2042212795 after retry RPC after error@88042983) -> (continuation of Deferred@1116414296 after retry RPC after error@295164665) -> (continuation of Deferred@622302489 after retry RPC after error@1538888713) -> (continuation of Deferred@1084485575 after retry RPC after error@1875686712) -> (continuation of Deferred@1995070085 after retry RPC after error@1642365325) -> (continuation of Deferred@1046910881 after retry RPC after error@873041952) -> (continuation of Deferred@278121046 after retry RPC after error@1438566688) -> (continuation of Deferred@1609537449 after retry RPC after error@664765668) -> (continuation of Deferred@701508411 after retry RPC after error@168038632) -> (continuation of Deferred@695573726 after retry RPC after error@1922467248) -> (continuation of Deferred@1522004266 after retry RPC after error@1881029060) -> (continuation of Deferred@1963513973 after retry RPC after error@863332449) -> (continuation of Deferred@1445912964 after retry RPC after error@1476342428) -> (continuation of Deferred@1678218086 after retry RPC after error@2083117543) -> (continuation of Deferred@1571431719 after retry RPC after error@1945081820) -> (continuation of Deferred@732669540 after retry RPC after error@436188183) -> (continuation of Deferred@359672082 after retry RPC after error@439225623) -> (continuation of Deferred@1816137904 after retry RPC after error@150691363) -> (continuation of Deferred@475520663 after retry RPC after error@1987788479) -> (continuation of Deferred@441611600 after retry RPC after error@1217018495) -> (continuation of Deferred@1779164831 after retry RPC after error@1168815015)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.62:39875
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:26:59.949 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
14:26:59.949 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
14:26:59.949 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RUNNING to RESTARTING.
14:26:59.949 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:26:59.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:26:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:59.670157 23832 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 23827
14:26:59.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:59.974530 23827 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.668s	user 0.632s	sys 1.016s
14:26:59.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:59.979712 23827 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.673s	user 0.633s	sys 1.016s
14:26:59.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:58.310252 23836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:59.987017 23827 server_base.cc:1061] running on GCE node
14:26:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:26:59.988624 23894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:26:59.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:59.989876 23827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:26:59.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:59.993336 23827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:26:59.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:59.994701 23827 hybrid_clock.cc:648] HybridClock initialized: now 1779114419994655 us; error 34 us; skew 500 ppm
14:26:59.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:26:59.995683 23827 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:26:59.997 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:26:59.997 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:26:59.997 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:26:59.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.997 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:26:59.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:26:59.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:26:59.998 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:00.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.003095 23827 webserver.cc:533] Webserver started at http://127.22.199.194:40651/ using document root <none> and password file <none>
14:27:00.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.004242 23827 fs_manager.cc:362] Metadata directory not provided
14:27:00.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.004534 23827 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:27:00.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.005059 23827 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:27:00.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.010246 23827 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data/instance:
14:27:00.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0c77e5128ac45a6bf03e93d503f4d89"
14:27:00.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:59 on dist-test-slave-1n46"
14:27:00.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.011541 23827 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal/instance:
14:27:00.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0c77e5128ac45a6bf03e93d503f4d89"
14:27:00.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:59 on dist-test-slave-1n46"
14:27:00.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.030556 23827 fs_manager.cc:696] Time spent creating directory manager: real 0.018s	user 0.009s	sys 0.010s
14:27:00.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.038865 23899 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:27:00.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.040225 23827 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.006s
14:27:00.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.040607 23827 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal
14:27:00.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0c77e5128ac45a6bf03e93d503f4d89"
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:26:59 on dist-test-slave-1n46"
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.040994 23827 fs_report.cc:389] FS layout report
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data/data
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:27:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:27:00.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.109177 23827 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:27:00.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.111075 23827 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:27:00.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.111610 23827 kserver.cc:163] Server-wide thread pool size limit: 3276
14:27:00.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.114975 23827 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:27:00.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.120699 23827 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:27:00.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.121004 23827 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:27:00.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.121299 23827 ts_tablet_manager.cc:616] Registered 0 tablets
14:27:00.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.121498 23827 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:27:00.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:00.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:00.227 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:00.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.228 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.228 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:00.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:00.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:00.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:00.281 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.282 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:00.286 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:00.286 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:00.286 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:00.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:00.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:00.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:00.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:00.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:00.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:00.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:00.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:00.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:00.287 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:00.300 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:00.301 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:00.301 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:00.301 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:00.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:00.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:00.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:00.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:00.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:00.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:00.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:00.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:00.301 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:00.309 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:00.310 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:00.310 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:00.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.310 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.310 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.310 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.310 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.310 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.311 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:00.340 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:00.340 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:00.341 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:00.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.341 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.341 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.341 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.342 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:00.342 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [12ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [12ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [120ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [684ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [923ms] refreshing cache from master, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [924ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [924ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [925ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1580ms] refreshing cache from master, [1580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@52739635(state=PENDING, result=null, callback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845), errback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845)))
14:27:00.343 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:27:00.343 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [12ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [12ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [120ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [684ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [923ms] refreshing cache from master, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [924ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [924ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [925ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1580ms] refreshing cache from master, [1580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@52739635(state=PENDING, result=null, callback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845), errback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.60:37961
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:00.344 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
14:27:00.345 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
14:27:00.347 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28353), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [12ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [12ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [22ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [86ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [86ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [120ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [141ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [141ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [163ms] refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [163ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [164ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [164ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [341ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [341ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [683ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [684ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [923ms] refreshing cache from master, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [924ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [924ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [925ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [925ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1580ms] refreshing cache from master, [1580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [1581ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@52739635(state=PENDING, result=null, callback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845), errback=(continuation of Deferred@1275613831 after retry RPC after error@335823549) -> (continuation of Deferred@1569804982 after retry RPC after error@2078456337) -> (continuation of Deferred@1978680192 after retry RPC after error@1129834025) -> (continuation of Deferred@335808535 after retry RPC after error@2052590260) -> (continuation of Deferred@230926908 after retry RPC after error@1901683459) -> (continuation of Deferred@1160350095 after retry RPC after error@2141074996) -> (continuation of Deferred@1864163761 after retry RPC after error@1432868394) -> (continuation of Deferred@1552632056 after retry RPC after error@1378544331) -> (continuation of Deferred@1521719382 after retry RPC after error@823055276) -> (continuation of Deferred@927236605 after retry RPC after error@842877292) -> (continuation of Deferred@1946818133 after retry RPC after error@861812939) -> (continuation of Deferred@537267252 after retry RPC after error@2024294257) -> (continuation of Deferred@1546931855 after retry RPC after error@518962594) -> (continuation of Deferred@236549607 after retry RPC after error@883964058) -> (continuation of Deferred@1242454197 after retry RPC after error@560398331) -> (continuation of Deferred@1687486589 after retry RPC after error@1372885149) -> (continuation of Deferred@1764205026 after retry RPC after error@2141721114) -> (continuation of Deferred@871523194 after retry RPC after error@1180130785) -> (continuation of Deferred@304860280 after retry RPC after error@757871845) -> (continuation of Deferred@233139081 after retry RPC after error@1906411393) -> (continuation of Deferred@1034280385 after retry RPC after error@1902271884) -> (continuation of Deferred@1476253962 after retry RPC after error@714985979) -> (continuation of Deferred@960842428 after retry RPC after error@1512631845)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.11.60:37961
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:00.348 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:27:00.348 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:00.348 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:00.348 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:00.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
14:27:00.349 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.349 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.349 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.349 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.349 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.350 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:00.350 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
14:27:00.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.383384 23827 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.194:38423
14:27:00.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.383510 24011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.194:38423 every 8 connection(s)
14:27:00.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.386220 23827 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/data/info.pb
14:27:00.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.387178 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 23827
14:27:00.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.387601 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-1/wal/instance
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.397931 23327 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/logs
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data/info.pb
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:27:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.195:0
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.195
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.195
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:27:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:27:00.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.434 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:00.434 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:00.435 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:00.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.435 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.436 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.436 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.436 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.436 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:00.442 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:00.442 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:00.442 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:00.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.443 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.444 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:00.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.453256 24012 heartbeater.cc:344] Connected to a master server at 127.22.199.252:43961
14:27:00.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.453666 24012 heartbeater.cc:461] Registering TS with master...
14:27:00.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.454926 24012 heartbeater.cc:507] Master 127.22.199.252:43961 requested a full tablet report, sending...
14:27:00.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.459468 24013 heartbeater.cc:344] Connected to a master server at 127.22.199.253:33945
14:27:00.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.459836 24013 heartbeater.cc:461] Registering TS with master...
14:27:00.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.459921 23537 ts_manager.cc:194] Registered new tserver with Master: f0c77e5128ac45a6bf03e93d503f4d89 (127.22.199.194:38423)
14:27:00.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.460788 24013 heartbeater.cc:507] Master 127.22.199.253:33945 requested a full tablet report, sending...
14:27:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.463263 24014 heartbeater.cc:344] Connected to a master server at 127.22.199.254:42535
14:27:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.463605 24014 heartbeater.cc:461] Registering TS with master...
14:27:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.464222 23452 ts_manager.cc:194] Registered new tserver with Master: f0c77e5128ac45a6bf03e93d503f4d89 (127.22.199.194:38423)
14:27:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.464496 24014 heartbeater.cc:507] Master 127.22.199.254:42535 requested a full tablet report, sending...
14:27:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.466660 23373 ts_manager.cc:194] Registered new tserver with Master: f0c77e5128ac45a6bf03e93d503f4d89 (127.22.199.194:38423)
14:27:00.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.467976 23373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.199.194:34827
14:27:00.517 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:00.517 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:00.517 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:00.518 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.518 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.518 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.518 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.518 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.518 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.518 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:00.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.665 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:00.666 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:00.666 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:00.666 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.666 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:00.666 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.666 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.666 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:00.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:00.667 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:00.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.698 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:00.699 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:00.699 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:00.699 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.699 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.699 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:00.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.699 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.699 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:00.699 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.699 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:00.699 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:00.701 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:27:00.702 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:27:00.702 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:27:00.702 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:00.702 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:00.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:00.702 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:00.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:00.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:00.702 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:00.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:00.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:00.702 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:27:00.733 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.733 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.733 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.733 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.734 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.734 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28732), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [21ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [23ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [42ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [382ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [843ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [843ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3083ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4061ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606)))
14:27:00.735 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.735 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.735 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.735 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28732), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [21ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [23ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [42ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [382ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [843ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [843ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3083ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4061ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28732), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [21ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [23ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [42ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [382ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [843ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [843ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3083ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4061ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.189:34071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:00.735 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.735 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.736 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.754 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.754 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.754 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.757 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28732), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [21ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [23ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [42ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [382ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [843ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [843ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3083ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4061ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28732), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [2ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [6ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [21ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [23ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [42ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [81ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [141ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [382ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [842ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [843ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [843ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [1483ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.190:41547: Network error: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.188:44337: Network error: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337, [3082ms] Sub RPC ConnectToMaster: received response from server master-127.11.83.189:34071: Network error: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [3083ms] delaying RPC due to: Service unavailable: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.190:41547, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.188:44337, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.83.189:34071, [4061ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.83.189:34071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:00.758 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.758 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.759 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.759 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.759 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.759 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.760 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.761 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:27:00.761 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
14:27:00.761 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
14:27:00.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
14:27:00.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
14:27:00.762 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:27:00.762 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
14:27:00.762 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:27:00.763 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:27:00.763 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
14:27:00.763 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
14:27:00.765 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
14:27:00.765 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
14:27:00.765 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
14:27:00.766 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
14:27:00.766 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
14:27:00.766 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
14:27:00.766 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
14:27:00.766 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
14:27:00.767 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
14:27:00.768 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
14:27:00.768 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:27:00.768 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job eb69507117e6ffaf90d8bea22e591f35
14:27:00.773 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.773 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.773 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.774 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.774 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.774 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.774 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.774 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.774 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.774 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.779 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:00.779 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:00.779 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:00.779 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:00.779 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:00.779 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:00.779 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:00.779 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:00.779 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:00.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:00.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:00.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:00.780 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:00.782 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:00.782 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:00.783 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:00.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.783 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.783 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.783 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.783 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:00.793 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.793 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.794 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.794 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.794 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.794 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.794 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.811780 24019 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:27:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.812458 24019 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:27:00.813 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.813 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.813 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.813055 24019 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:27:00.813 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.813 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.814 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.850869 24019 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:27:00.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.851691 24019 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.199.195
14:27:00.852 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.852 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.853 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.853 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.853 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.853 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.873 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.873 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.873 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.873 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.874 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.892802 24019 tablet_server_runner.cc:78] Tablet server non-default flags:
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.199.212:40117
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.199.195:0
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data/info.pb
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.199.195
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.199.254:42535,127.22.199.253:33945,127.22.199.252:43961
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.199.195
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/logs
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:27:00.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:27:00.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.894361 24019 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:27:00.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:00.896168 24019 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:27:00.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:00.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:00.899 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:00.899 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.899 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.899 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:00.899 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.899 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:00.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:00.899 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:00.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.908878 24037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:27:00.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.934 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:00.934 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:00.934 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:00.934 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.934 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.934 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:00.934 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.934 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.934 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:00.935 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.935 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.935 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:00.935 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:00.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:00.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:00.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:00.973 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:00.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:00.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:00.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:00.975 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:01.079 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:01.079 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:01.079 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:01.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.079 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.080 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.080 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.080 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:01.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:01.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:01.113 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:01.114 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.114 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.114 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.114 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:01.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.180 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:01.180 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:01.180 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:01.181 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:01.181 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:01.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:01.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:01.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:01.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:01.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:01.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:01.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:01.182 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:01.279 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:01.279 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:01.279 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:01.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.280 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:01.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:01.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:01.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:01.320 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.320 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.320 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.320 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.320 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.320 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.321 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:01.358 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:01.358 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:01.358 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:01.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:01.359 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.359 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:01.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:01.360 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:01.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:01.471562 24014 heartbeater.cc:499] Master 127.22.199.254:42535 was elected leader, sending a full tablet report...
14:27:01.537 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:01.537 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:01.537 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:01.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.538 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.538 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.538 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.542 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.542 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.542 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.542 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:01.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:01.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:01.587 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:01.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.588 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.588 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.588 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.589 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:01.590 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29611), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [16ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [20ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [26ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [27ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [29ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [29ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [61ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [82ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [181ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [181ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [262ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [503ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [762ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [762ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [763ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [763ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [983ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [983ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [984ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2361ms] refreshing cache from master, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2362ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2362ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [3501ms] refreshing cache from master, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [3502ms] too many traces: truncated at 100 traces, deferred=Deferred@943765697(state=PENDING, result=null, callback=(continuation of Deferred@2144737501 after retry RPC after error@6316644) -> (continuation of Deferred@1732707403 after retry RPC after error@1518091986) -> (continuation of Deferred@354665904 after retry RPC after error@382985778) -> (continuation of Deferred@1240063487 after retry RPC after error@1918431422) -> (continuation of Deferred@2044572928 after retry RPC after error@1890991743) -> (continuation of Deferred@2008486835 after retry RPC after error@1121960187) -> (continuation of Deferred@1455298581 after retry RPC after error@389710203) -> (continuation of Deferred@1491018404 after retry RPC after error@1681652060) -> (continuation of Deferred@1113795454 after retry RPC after error@26303248) -> (continuation of Deferred@544904068 after retry RPC after error@464551886) -> (continuation of Deferred@1079222045 after retry RPC after error@1267799516) -> (continuation of Deferred@1065568665 after retry RPC after error@659890088) -> (continuation of Deferred@2074265384 after retry RPC after error@945685109) -> (continuation of Deferred@489970534 after retry RPC after error@303279927) -> (continuation of Deferred@2145755610 after retry RPC after error@937449977) -> (continuation of Deferred@145804040 after retry RPC after error@131446590) -> (continuation of Deferred@1441541487 after retry RPC after error@1618381242) -> (continuation of Deferred@1846601271 after retry RPC after error@1154928780) -> (continuation of Deferred@1894058540 after retry RPC after error@604665555) -> (continuation of Deferred@1296174395 after retry RPC after error@1071834799) -> (continuation of Deferred@1737371413 after retry RPC after error@272986585) -> (continuation of Deferred@1295224127 after retry RPC after error@1699532200) -> (continuation of Deferred@1940693139 after retry RPC after error@1214041222) -> (continuation of Deferred@433584839 after retry RPC after error@443897304) -> (continuation of Deferred@206296637 after retry RPC after error@576525262), errback=(continuation of Deferred@2144737501 after retry RPC after error@6316644) -> (continuation of Deferred@1732707403 after retry RPC after error@1518091986) -> (continuation of Deferred@354665904 after retry RPC after error@382985778) -> (continuation of Deferred@1240063487 after retry RPC after error@1918431422) -> (continuation of Deferred@2044572928 after retry RPC after error@1890991743) -> (continuation of Deferred@2008486835 after retry RPC after error@1121960187) -> (continuation of Deferred@1455298581 after retry RPC after error@389710203) -> (continuation of Deferred@1491018404 after retry RPC after error@1681652060) -> (continuation of Deferred@1113795454 after retry RPC after error@26303248) -> (continuation of Deferred@544904068 after retry RPC after error@464551886) -> (continuation of Deferred@1079222045 after retry RPC after error@1267799516) -> (continuation of Deferred@1065568665 after retry RPC after error@659890088) -> (continuation of Deferred@2074265384 after retry RPC after error@945685109) -> (continuation of Deferred@489970534 after retry RPC after error@303279927) -> (continuation of Deferred@2145755610 after retry RPC after error@937449977) -> (continuation of Deferred@145804040 after retry RPC after error@131446590) -> (continuation of Deferred@1441541487 after retry RPC after error@1618381242) -> (continuation of Deferred@1846601271 after retry RPC after error@1154928780) -> (continuation of Deferred@1894058540 after retry RPC after error@604665555) -> (continuation of Deferred@1296174395 after retry RPC after error@1071834799) -> (continuation of Deferred@1737371413 after retry RPC after error@272986585) -> (continuation of Deferred@1295224127 after retry RPC after error@1699532200) -> (continuation of Deferred@1940693139 after retry RPC after error@1214041222) -> (continuation of Deferred@433584839 after retry RPC after error@443897304) -> (continuation of Deferred@206296637 after retry RPC after error@576525262)))
14:27:01.591 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:01.591 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:01.591 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:01.592 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.592 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.592 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.592 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.592 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.592 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.592 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.592 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.592 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.593 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:01.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.613 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:01.614 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:01.614 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:01.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.614 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:01.658 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:01.659 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:01.659 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:01.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:01.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:01.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:01.660 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:01.661 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [4ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [13ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [13ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [21ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [22ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [23ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [24ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [42ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [61ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [62ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [62ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [81ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [81ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [121ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [321ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [321ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [762ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [762ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [762ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [762ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [941ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [942ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2420ms] refreshing cache from master, [2420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.60:37961: Network error: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.61:45967: Network error: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.12.11.62:39875: Network error: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [2421ms] delaying RPC due to: Service unavailable: Master config (127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.60:37961, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.61:45967, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.11.62:39875, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1376519074(state=PENDING, result=null, callback=(continuation of Deferred@1294897457 after retry RPC after error@963509538) -> (continuation of Deferred@917198280 after retry RPC after error@67649964) -> (continuation of Deferred@1024917253 after retry RPC after error@1799651688) -> (continuation of Deferred@128818397 after retry RPC after error@1106159781) -> (continuation of Deferred@1258981706 after retry RPC after error@67772034) -> (continuation of Deferred@1873424810 after retry RPC after error@1538594682) -> (continuation of Deferred@1147835807 after retry RPC after error@272657822) -> (continuation of Deferred@777599325 after retry RPC after error@1562699051) -> (continuation of Deferred@1307727229 after retry RPC after error@1582169536) -> (continuation of Deferred@968471685 after retry RPC after error@1129186084) -> (continuation of Deferred@474546061 after retry RPC after error@769307193) -> (continuation of Deferred@1496524443 after retry RPC after error@1792498106) -> (continuation of Deferred@834168826 after retry RPC after error@1233866894) -> (continuation of Deferred@156016858 after retry RPC after error@1493574336) -> (continuation of Deferred@728959405 after retry RPC after error@946807661) -> (continuation of Deferred@1422466762 after retry RPC after error@1009858225) -> (continuation of Deferred@264007419 after retry RPC after error@1317617706) -> (continuation of Deferred@1378494591 after retry RPC after error@1729828917) -> (continuation of Deferred@196901275 after retry RPC after error@263254230) -> (continuation of Deferred@215632015 after retry RPC after error@859775889) -> (continuation of Deferred@1529345228 after retry RPC after error@1402571070) -> (continuation of Deferred@232340978 after retry RPC after error@1194374259) -> (continuation of Deferred@601209293 after retry RPC after error@1008338160) -> (continuation of Deferred@2028505132 after retry RPC after error@976828526), errback=(continuation of Deferred@1294897457 after retry RPC after error@963509538) -> (continuation of Deferred@917198280 after retry RPC after error@67649964) -> (continuation of Deferred@1024917253 after retry RPC after error@1799651688) -> (continuation of Deferred@128818397 after retry RPC after error@1106159781) -> (continuation of Deferred@1258981706 after retry RPC after error@67772034) -> (continuation of Deferred@1873424810 after retry RPC after error@1538594682) -> (continuation of Deferred@1147835807 after retry RPC after error@272657822) -> (continuation of Deferred@777599325 after retry RPC after error@1562699051) -> (continuation of Deferred@1307727229 after retry RPC after error@1582169536) -> (continuation of Deferred@968471685 after retry RPC after error@1129186084) -> (continuation of Deferred@474546061 after retry RPC after error@769307193) -> (continuation of Deferred@1496524443 after retry RPC after error@1792498106) -> (continuation of Deferred@834168826 after retry RPC after error@1233866894) -> (continuation of Deferred@156016858 after retry RPC after error@1493574336) -> (continuation of Deferred@728959405 after retry RPC after error@946807661) -> (continuation of Deferred@1422466762 after retry RPC after error@1009858225) -> (continuation of Deferred@264007419 after retry RPC after error@1317617706) -> (continuation of Deferred@1378494591 after retry RPC after error@1729828917) -> (continuation of Deferred@196901275 after retry RPC after error@263254230) -> (continuation of Deferred@215632015 after retry RPC after error@859775889) -> (continuation of Deferred@1529345228 after retry RPC after error@1402571070) -> (continuation of Deferred@232340978 after retry RPC after error@1194374259) -> (continuation of Deferred@601209293 after retry RPC after error@1008338160) -> (continuation of Deferred@2028505132 after retry RPC after error@976828526)))
14:27:01.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.694 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:01.695 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:01.695 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:01.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:01.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:01.696 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.696 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.696 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:01.696 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:01.736 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:01.736 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:01.736 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:01.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.737 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.737 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.737 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.737 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:01.741 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:01.741 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:01.742 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:01.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:01.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:01.743 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.743 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.743 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:01.743 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:01.813 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:01.813 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:01.814 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:01.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:01.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:01.815 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.815 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.815 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:01.815 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:01.882 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:01.882 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:01.882 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:01.883 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.883 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.883 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.883 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:01.883 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:01.883 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.883 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.883 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:01.883 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:01.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:01.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:01.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:01.947 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:01.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:01.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:01.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:01.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:01.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:01.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:01.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:01.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:01.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:01.948 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:01.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.488 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:02.489 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:02.489 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:02.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:02.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:02.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:02.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:02.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:02.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:02.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:02.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:02.490 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:02.490 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:02.600 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:02.601 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:02.601 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:02.601 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:02.601 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:02.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:02.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:02.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:02.602 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:02.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:02.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:02.604 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.601 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:02.604 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:02.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:00.910493 24038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:27:02.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:02.313315 24036 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 24019
14:27:02.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:02.631839 24019 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.722s	user 0.503s	sys 1.023s
14:27:02.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:02.634052 24019 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.724s	user 0.503s	sys 1.023s
14:27:02.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:02.634215 24040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:27:02.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:02.638846 24039 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1723 milliseconds
14:27:02.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.638861 24019 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:27:02.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.640205 24019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:27:02.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.642540 24019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:27:02.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.643901 24019 hybrid_clock.cc:648] HybridClock initialized: now 1779114422643832 us; error 89 us; skew 500 ppm
14:27:02.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.644703 24019 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:27:02.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.650777 24019 webserver.cc:533] Webserver started at http://127.22.199.195:39891/ using document root <none> and password file <none>
14:27:02.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.651721 24019 fs_manager.cc:362] Metadata directory not provided
14:27:02.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.651947 24019 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:27:02.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.652449 24019 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:27:02.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.657042 24019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data/instance:
14:27:02.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e402b58e1e52489f83db8181e5bd0d5a"
14:27:02.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:27:02 on dist-test-slave-1n46"
14:27:02.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.658180 24019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal/instance:
14:27:02.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e402b58e1e52489f83db8181e5bd0d5a"
14:27:02.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:27:02 on dist-test-slave-1n46"
14:27:02.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.665499 24019 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
14:27:02.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.671492 24050 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:27:02.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.672699 24019 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.672945 24019 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data,/tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e402b58e1e52489f83db8181e5bd0d5a"
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:27:02 on dist-test-slave-1n46"
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.673261 24019 fs_report.cc:389] FS layout report
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data/data
14:27:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:27:02.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:27:02.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.733597 24019 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:27:02.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.735332 24019 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:27:02.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.735703 24019 kserver.cc:163] Server-wide thread pool size limit: 3276
14:27:02.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.738353 24019 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:27:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.742823 24019 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:27:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.743019 24019 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:27:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.743234 24019 ts_tablet_manager.cc:616] Registered 0 tablets
14:27:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.743378 24019 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:27:02.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:02.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:02.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:02.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:02.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:02.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:02.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:02.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:02.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:02.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:02.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:02.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:02.755 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:02.874 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:02.875 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:02.875 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:02.875 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:02.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:02.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:02.875 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:02.875 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:02.875 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:02.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:02.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:02.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:02.876 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:02.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.911938 24019 rpc_server.cc:307] RPC server started. Bound to: 127.22.199.195:36379
14:27:02.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.912066 24162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.199.195:36379 every 8 connection(s)
14:27:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.914639 24019 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/data/info.pb
14:27:02.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.920861 23327 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu as pid 24019
14:27:02.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.921350 23327 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskHAyHVV/test-tmp/mini-kudu-cluster6648575033842110695/ts-2/wal/instance
14:27:02.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:02.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.976519 24165 heartbeater.cc:344] Connected to a master server at 127.22.199.254:42535
14:27:02.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.977021 24165 heartbeater.cc:461] Registering TS with master...
14:27:02.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.978263 24165 heartbeater.cc:507] Master 127.22.199.254:42535 requested a full tablet report, sending...
14:27:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.980574 23373 ts_manager.cc:194] Registered new tserver with Master: e402b58e1e52489f83db8181e5bd0d5a (127.22.199.195:36379)
14:27:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.981604 24163 heartbeater.cc:344] Connected to a master server at 127.22.199.252:43961
14:27:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.981937 24163 heartbeater.cc:461] Registering TS with master...
14:27:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.982357 23373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.199.195:51751
14:27:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.982805 24163 heartbeater.cc:507] Master 127.22.199.252:43961 requested a full tablet report, sending...
14:27:02.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.986088 23536 ts_manager.cc:194] Registered new tserver with Master: e402b58e1e52489f83db8181e5bd0d5a (127.22.199.195:36379)
14:27:02.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.988821 24164 heartbeater.cc:344] Connected to a master server at 127.22.199.253:33945
14:27:02.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.989140 24164 heartbeater.cc:461] Registering TS with master...
14:27:02.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.989778 24164 heartbeater.cc:507] Master 127.22.199.253:33945 requested a full tablet report, sending...
14:27:02.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.991986 23452 ts_manager.cc:194] Registered new tserver with Master: e402b58e1e52489f83db8181e5bd0d5a (127.22.199.195:36379)
14:27:02.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:02.995903 23327 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:27:03.008 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:27:03.008 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:27:03.009 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.199.254"
      port: 42535
    }
    bound_http_address {
      host: "127.22.199.254"
      port: 43587
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.199.253"
      port: 33945
    }
    bound_http_address {
      host: "127.22.199.253"
      port: 42875
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.199.252"
      port: 43961
    }
    bound_http_address {
      host: "127.22.199.252"
      port: 43041
    }
  }
}

14:27:03.009 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:27:03.010 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.199.193"
      port: 34781
    }
    bound_http_address {
      host: "127.22.199.193"
      port: 43577
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.199.194"
      port: 38423
    }
    bound_http_address {
      host: "127.22.199.194"
      port: 40651
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.199.195"
      port: 36379
    }
    bound_http_address {
      host: "127.22.199.195"
      port: 39891
    }
  }
}

14:27:03.010 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:27:03.011 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:03.014 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:03.015 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:03.015 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.234.62:34045(127.21.234.62:34045)] Successfully connected to peer
14:27:03.015 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:03.016 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.234.61:40633(127.21.234.61:40633)] Successfully connected to peer
14:27:03.022 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:03.022 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:03.023 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:03.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.023 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.234.60:44393(127.21.234.60:44393)] Successfully connected to peer
14:27:03.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.023 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.023 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:03.032 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.62
14:27:03.033 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.61
14:27:03.034 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.60
14:27:03.043 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:03.043 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:03.047 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x91d7f64c, L:/127.0.0.1:60518 - R:/127.21.234.61:40633] using SASL/PLAIN
14:27:03.047 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x09222573, L:/127.0.0.1:59496 - R:/127.21.234.60:44393] using SASL/PLAIN
14:27:03.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:03.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.62:34045, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.61:40633, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.60:44393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.60:44393: OK, deferred=null) after lookup
14:27:03.052 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:03.054 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe7ad40af, L:/127.0.0.1:48460 - R:/127.21.234.62:34045] using SASL/PLAIN
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.069025 22694 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59496:
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:27:03.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:03.077327 22694 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:27:03.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.144 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:03.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.224696 23058 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd0f745fcce4200bdd168b6ce87370a (DEFAULT_TABLE table=replication_test_table [id=42d6860ec9d345d6b7954cff96fde981]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.227396 23058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd0f745fcce4200bdd168b6ce87370a. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:03.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.231323 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd0f745fcce4200bdd168b6ce87370a (DEFAULT_TABLE table=replication_test_table [id=42d6860ec9d345d6b7954cff96fde981]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:03.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.233533 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd0f745fcce4200bdd168b6ce87370a. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:03.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.263751 24198 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Bootstrap starting.
14:27:03.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.269697 24199 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Bootstrap starting.
14:27:03.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.271426 24198 tablet_bootstrap.cc:654] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Neither blocks nor log segments found. Creating new log.
14:27:03.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.273494 24198 log.cc:826] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Log is configured to *not* fsync() on all Append() calls
14:27:03.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.278494 24199 tablet_bootstrap.cc:654] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Neither blocks nor log segments found. Creating new log.
14:27:03.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.280988 24199 log.cc:826] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Log is configured to *not* fsync() on all Append() calls
14:27:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.285015 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd0f745fcce4200bdd168b6ce87370a (DEFAULT_TABLE table=replication_test_table [id=42d6860ec9d345d6b7954cff96fde981]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.286868 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd0f745fcce4200bdd168b6ce87370a. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:03.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.296693 24198 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: No bootstrap required, opened a new log
14:27:03.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.297430 24198 ts_tablet_manager.cc:1403] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.009s
14:27:03.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.304492 24199 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: No bootstrap required, opened a new log
14:27:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.304913 24199 ts_tablet_manager.cc:1403] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.010s
14:27:03.306 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:03.307 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:03.307 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:03.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.308 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:03.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.312816 24202 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Bootstrap starting.
14:27:03.317 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:03.317 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:03.318 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:03.318 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.318 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.318 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.318 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.318 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.318 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.318 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.318 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.318 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.318 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:03.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.319491 24202 tablet_bootstrap.cc:654] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Neither blocks nor log segments found. Creating new log.
14:27:03.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.321486 24202 log.cc:826] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Log is configured to *not* fsync() on all Append() calls
14:27:03.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.326839 24202 tablet_bootstrap.cc:492] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: No bootstrap required, opened a new log
14:27:03.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.327189 24202 ts_tablet_manager.cc:1403] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
14:27:03.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.328210 24198 raft_consensus.cc:359] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.329043 24198 raft_consensus.cc:385] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:03.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.329404 24198 raft_consensus.cc:740] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2410af928954a1d9d406c3d02ffe411, State: Initialized, Role: FOLLOWER
14:27:03.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.330441 24198 consensus_queue.cc:260] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.335081 24198 ts_tablet_manager.cc:1434] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Time spent starting tablet: real 0.037s	user 0.025s	sys 0.007s
14:27:03.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.337721 24199 raft_consensus.cc:359] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.338541 24199 raft_consensus.cc:385] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:03.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.338809 24199 raft_consensus.cc:740] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d8f5b62daa24337b68f63e539a22a3a, State: Initialized, Role: FOLLOWER
14:27:03.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.339643 24199 consensus_queue.cc:260] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.351506 24199 ts_tablet_manager.cc:1434] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Time spent starting tablet: real 0.046s	user 0.022s	sys 0.011s
14:27:03.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.361774 24202 raft_consensus.cc:359] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.362478 24202 raft_consensus.cc:385] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:03.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.362779 24202 raft_consensus.cc:740] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8e733c2e2b4440b94f05b991bb5407f, State: Initialized, Role: FOLLOWER
14:27:03.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.363518 24202 consensus_queue.cc:260] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.367189 24202 ts_tablet_manager.cc:1434] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Time spent starting tablet: real 0.040s	user 0.023s	sys 0.007s
14:27:03.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:03.369012 23128 tablet.cc:2404] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:03.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:03.480028 23324 tablet.cc:2404] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:03.555819 22992 tablet.cc:2404] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:03.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.572886 24204 raft_consensus.cc:493] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:27:03.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.573357 24204 raft_consensus.cc:515] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.576110 24204 leader_election.cc:290] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d8f5b62daa24337b68f63e539a22a3a (127.21.234.3:42127), e8e733c2e2b4440b94f05b991bb5407f (127.21.234.1:36065)
14:27:03.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.589728 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd0f745fcce4200bdd168b6ce87370a" candidate_uuid: "e2410af928954a1d9d406c3d02ffe411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d8f5b62daa24337b68f63e539a22a3a" is_pre_election: true
14:27:03.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.590683 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd0f745fcce4200bdd168b6ce87370a" candidate_uuid: "e2410af928954a1d9d406c3d02ffe411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8e733c2e2b4440b94f05b991bb5407f" is_pre_election: true
14:27:03.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.591019 23224 raft_consensus.cc:2468] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2410af928954a1d9d406c3d02ffe411 in term 0.
14:27:03.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.591490 22937 raft_consensus.cc:2468] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2410af928954a1d9d406c3d02ffe411 in term 0.
14:27:03.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.592487 23012 leader_election.cc:304] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d8f5b62daa24337b68f63e539a22a3a, e2410af928954a1d9d406c3d02ffe411; no voters: 
14:27:03.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.593137 24204 raft_consensus.cc:2804] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:27:03.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.593425 24204 raft_consensus.cc:493] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:27:03.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.593611 24204 raft_consensus.cc:3060] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 0 FOLLOWER]: Advancing to term 1
14:27:03.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.598851 24204 raft_consensus.cc:515] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.600654 24204 leader_election.cc:290] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [CANDIDATE]: Term 1 election: Requested vote from peers 3d8f5b62daa24337b68f63e539a22a3a (127.21.234.3:42127), e8e733c2e2b4440b94f05b991bb5407f (127.21.234.1:36065)
14:27:03.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.601167 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd0f745fcce4200bdd168b6ce87370a" candidate_uuid: "e2410af928954a1d9d406c3d02ffe411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d8f5b62daa24337b68f63e539a22a3a"
14:27:03.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.601276 22937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd0f745fcce4200bdd168b6ce87370a" candidate_uuid: "e2410af928954a1d9d406c3d02ffe411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8e733c2e2b4440b94f05b991bb5407f"
14:27:03.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.601554 23224 raft_consensus.cc:3060] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 0 FOLLOWER]: Advancing to term 1
14:27:03.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.601650 22937 raft_consensus.cc:3060] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 0 FOLLOWER]: Advancing to term 1
14:27:03.606 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.607151 22937 raft_consensus.cc:2468] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2410af928954a1d9d406c3d02ffe411 in term 1.
14:27:03.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.607918 23224 raft_consensus.cc:2468] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2410af928954a1d9d406c3d02ffe411 in term 1.
14:27:03.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.608155 23014 leader_election.cc:304] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2410af928954a1d9d406c3d02ffe411, e8e733c2e2b4440b94f05b991bb5407f; no voters: 
14:27:03.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.608788 24204 raft_consensus.cc:2804] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 1 FOLLOWER]: Leader election won for term 1
14:27:03.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.610834 24204 raft_consensus.cc:697] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [term 1 LEADER]: Becoming Leader. State: Replica: e2410af928954a1d9d406c3d02ffe411, State: Running, Role: LEADER
14:27:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.611688 24204 consensus_queue.cc:237] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } }
14:27:03.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:03.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:03.616 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:03.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.617 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.617 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.618 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.618 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.618 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:03.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.623312 22694 catalog_manager.cc:5697] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2410af928954a1d9d406c3d02ffe411 (127.21.234.2). New cstate: current_term: 1 leader_uuid: "e2410af928954a1d9d406c3d02ffe411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2410af928954a1d9d406c3d02ffe411" member_type: VOTER last_known_addr { host: "127.21.234.2" port: 46667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 } health_report { overall_health: UNKNOWN } } }
14:27:03.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.781 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:03.781 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:03.781 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:03.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:03.781 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:03.781 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:03.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:03.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:03.781 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:03.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:03.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:03.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:03.781 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:03.790 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:03.790 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:03.790 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:03.790 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.790 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.790 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.790 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.790 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.790 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.790 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:03.806 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:03.806 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:03.807 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:03.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.807 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:03.835 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:03.835 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:03.835 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:03.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.836 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.836 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.836 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.836 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:03.894 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:03.895 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:03.895 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:03.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.895 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.895 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:03.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.895 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:03.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:03.895 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:03.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.939 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:03.939 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:03.940 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:03.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.940 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:03.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.940 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.940 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:03.940 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:03.940 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:03.945 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:03.945 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:03.946 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:03.946 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.946 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.946 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:03.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:03.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.946 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.946 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:03.946 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:03.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:03.959 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:03.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1dd0f745fcce4200bdd168b6ce87370a for table 'replication_test_table' with partition [<start>, <end>)
14:27:03.972 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127),e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)[L],e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:03.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.234.60:44393, [3ms] Sub RPC GetTableLocations: received response from server master-127.21.234.60:44393: OK, deferred=null) after lookup
14:27:03.973 [DEBUG - kudu-nio-2] (Connection.java:748) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] connecting to peer
14:27:03.973 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] Successfully connected to peer
14:27:03.983 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:03.986 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x850bd436, L:/127.0.0.1:53088 - R:/127.21.234.2:46667] using TOKEN/null
14:27:03.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:03.988809 24165 heartbeater.cc:499] Master 127.22.199.254:42535 was elected leader, sending a full tablet report...
14:27:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.001367 23224 raft_consensus.cc:1275] T 1dd0f745fcce4200bdd168b6ce87370a P 3d8f5b62daa24337b68f63e539a22a3a [term 1 FOLLOWER]: Refusing update from remote peer e2410af928954a1d9d406c3d02ffe411: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:27:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.001362 22937 raft_consensus.cc:1275] T 1dd0f745fcce4200bdd168b6ce87370a P e8e733c2e2b4440b94f05b991bb5407f [term 1 FOLLOWER]: Refusing update from remote peer e2410af928954a1d9d406c3d02ffe411: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:27:04.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.002827 24210 consensus_queue.cc:1048] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d8f5b62daa24337b68f63e539a22a3a" member_type: VOTER last_known_addr { host: "127.21.234.3" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:27:04.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.003530 24204 consensus_queue.cc:1048] T 1dd0f745fcce4200bdd168b6ce87370a P e2410af928954a1d9d406c3d02ffe411 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8e733c2e2b4440b94f05b991bb5407f" member_type: VOTER last_known_addr { host: "127.21.234.1" port: 36065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:27:04.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.037163 24214 mvcc.cc:204] Tried to move back new op lower bound from 7287252680691785728 to 7287252679122280448. Current Snapshot: MvccSnapshot[applied={T|T < 7287252680691785728}]
14:27:04.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.278 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:04.285 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:04.288 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:04.288 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:04.288 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:04.290 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:04.291 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:04.292 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:04.295 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:04.304 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.253
14:27:04.307 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.311 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x65377229, L:/127.0.0.1:46712 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:04.314 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:04.314 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=28), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, [26ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, deferred=null) after lookup
14:27:04.317 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:04.318 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.323 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.324 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd13b4a9f, L:/127.0.0.1:36994 - R:/127.22.199.253:33945] using SASL/PLAIN
14:27:04.325 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:04.326 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4f7ae534, L:/127.0.0.1:36942 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:04.327 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:04.328 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.234.62:34045(127.21.234.62:34045)] Successfully connected to peer
14:27:04.331 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.62
14:27:04.336 [DEBUG - main] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:04.336 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.234.61:40633(127.21.234.61:40633)] Successfully connected to peer
14:27:04.337 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.234.60:44393(127.21.234.60:44393)] Successfully connected to peer
14:27:04.339 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.340 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.60
14:27:04.343 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5b73ef00, L:/127.0.0.1:48462 - R:/127.21.234.62:34045] using SASL/PLAIN
14:27:04.348 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.351 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x12a2fd22, L:/127.0.0.1:59506 - R:/127.21.234.60:44393] using SASL/PLAIN
14:27:04.351 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.61
14:27:04.354 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:04.354 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=36), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.62:34045, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.61:40633, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.60:44393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.62:34045: OK, [28ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.60:44393: OK, deferred=null) after lookup
14:27:04.357 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:04.357 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:04.360 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1dd0f745fcce4200bdd168b6ce87370a for table 'replication_test_table' with partition [<start>, <end>)
14:27:04.360 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc1a481d7, L:/127.0.0.1:60530 - R:/127.21.234.61:40633] using SASL/PLAIN
14:27:04.360 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127),e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)[L],e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.362656 23373 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46712:
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
14:27:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\000\000\000\007\000\000\000\000"
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:27:04.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
14:27:04.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:04.367997 23373 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:27:04.412 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:04.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.443228 23733 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 (DEFAULT_TABLE table=replication_test_table [id=8f80318a90fd416c8a7cd6a0165ea9d0]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:04.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.445029 23733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:04.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.475795 24256 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Bootstrap starting.
14:27:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.482816 24256 tablet_bootstrap.cc:654] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Neither blocks nor log segments found. Creating new log.
14:27:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.482513 23947 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 (DEFAULT_TABLE table=replication_test_table [id=8f80318a90fd416c8a7cd6a0165ea9d0]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:04.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.484102 23947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.485015 24256 log.cc:826] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Log is configured to *not* fsync() on all Append() calls
14:27:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.487310 24098 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 (DEFAULT_TABLE table=replication_test_table [id=8f80318a90fd416c8a7cd6a0165ea9d0]), partition=RANGE (int8) PARTITION UNBOUNDED
14:27:04.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.490674 24256 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: No bootstrap required, opened a new log
14:27:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.491039 24256 ts_tablet_manager.cc:1403] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
14:27:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.491345 24098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd4f47cde3f420fa3d9039dfd03f7c8. 1 dirs total, 0 dirs full, 0 dirs failed
14:27:04.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.513725 24256 raft_consensus.cc:359] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.514607 24256 raft_consensus.cc:385] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:04.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.514885 24256 raft_consensus.cc:740] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5615ae745041414ab387d8f10a17a5cc, State: Initialized, Role: FOLLOWER
14:27:04.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.515722 24256 consensus_queue.cc:260] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.519 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:04.519 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:04.520 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.520025 24256 ts_tablet_manager.cc:1434] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Time spent starting tablet: real 0.029s	user 0.025s	sys 0.004s
14:27:04.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.520 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.521 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:04.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.533017 24260 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Bootstrap starting.
14:27:04.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.538774 24261 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Bootstrap starting.
14:27:04.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.546455 24261 tablet_bootstrap.cc:654] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Neither blocks nor log segments found. Creating new log.
14:27:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.548823 24260 tablet_bootstrap.cc:654] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Neither blocks nor log segments found. Creating new log.
14:27:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.548782 24261 log.cc:826] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Log is configured to *not* fsync() on all Append() calls
14:27:04.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.551396 24260 log.cc:826] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Log is configured to *not* fsync() on all Append() calls
14:27:04.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.554981 24261 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: No bootstrap required, opened a new log
14:27:04.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.555573 24261 ts_tablet_manager.cc:1403] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
14:27:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.557231 24260 tablet_bootstrap.cc:492] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: No bootstrap required, opened a new log
14:27:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.557752 24260 ts_tablet_manager.cc:1403] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.012s
14:27:04.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.583287 24261 raft_consensus.cc:359] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.584159 24261 raft_consensus.cc:385] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:04.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.584445 24261 raft_consensus.cc:740] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e402b58e1e52489f83db8181e5bd0d5a, State: Initialized, Role: FOLLOWER
14:27:04.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.585419 24261 consensus_queue.cc:260] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.586520 24260 raft_consensus.cc:359] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.587558 24260 raft_consensus.cc:385] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:27:04.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.587852 24260 raft_consensus.cc:740] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0c77e5128ac45a6bf03e93d503f4d89, State: Initialized, Role: FOLLOWER
14:27:04.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.588673 24260 consensus_queue.cc:260] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.592742 24260 ts_tablet_manager.cc:1434] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Time spent starting tablet: real 0.035s	user 0.028s	sys 0.005s
14:27:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.595026 24261 ts_tablet_manager.cc:1434] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Time spent starting tablet: real 0.039s	user 0.028s	sys 0.005s
14:27:04.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.630 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:04.630 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:04.630 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:04.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:04.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:04.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:04.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:04.630 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:04.630 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:04.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:04.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:04.631 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:04.631 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:04.662927 23824 tablet.cc:2404] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:04.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:04.675689 24020 tablet.cc:2404] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:04.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.720027 24265 raft_consensus.cc:493] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:27:04.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.720642 24265 raft_consensus.cc:515] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.723706 24265 leader_election.cc:290] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5615ae745041414ab387d8f10a17a5cc (127.22.199.193:34781), e402b58e1e52489f83db8181e5bd0d5a (127.22.199.195:36379)
14:27:04.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:27:04.731321 24166 tablet.cc:2404] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:27:04.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.735860 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd4f47cde3f420fa3d9039dfd03f7c8" candidate_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e402b58e1e52489f83db8181e5bd0d5a" is_pre_election: true
14:27:04.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.736740 24118 raft_consensus.cc:2468] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0c77e5128ac45a6bf03e93d503f4d89 in term 0.
14:27:04.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.738096 23902 leader_election.cc:304] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e402b58e1e52489f83db8181e5bd0d5a, f0c77e5128ac45a6bf03e93d503f4d89; no voters: 
14:27:04.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.738184 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd4f47cde3f420fa3d9039dfd03f7c8" candidate_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5615ae745041414ab387d8f10a17a5cc" is_pre_election: true
14:27:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.738731 24265 raft_consensus.cc:2804] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:27:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.739044 24265 raft_consensus.cc:493] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:27:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.738945 23772 raft_consensus.cc:2468] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0c77e5128ac45a6bf03e93d503f4d89 in term 0.
14:27:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.739373 24265 raft_consensus.cc:3060] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 0 FOLLOWER]: Advancing to term 1
14:27:04.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.744457 24265 raft_consensus.cc:515] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.745937 24265 leader_election.cc:290] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [CANDIDATE]: Term 1 election: Requested vote from peers 5615ae745041414ab387d8f10a17a5cc (127.22.199.193:34781), e402b58e1e52489f83db8181e5bd0d5a (127.22.199.195:36379)
14:27:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.746711 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd4f47cde3f420fa3d9039dfd03f7c8" candidate_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5615ae745041414ab387d8f10a17a5cc"
14:27:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.747260 23772 raft_consensus.cc:3060] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 0 FOLLOWER]: Advancing to term 1
14:27:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.747299 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd4f47cde3f420fa3d9039dfd03f7c8" candidate_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e402b58e1e52489f83db8181e5bd0d5a"
14:27:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.747797 24118 raft_consensus.cc:3060] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 0 FOLLOWER]: Advancing to term 1
14:27:04.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.752930 24118 raft_consensus.cc:2468] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P e402b58e1e52489f83db8181e5bd0d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0c77e5128ac45a6bf03e93d503f4d89 in term 1.
14:27:04.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.752902 23772 raft_consensus.cc:2468] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P 5615ae745041414ab387d8f10a17a5cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0c77e5128ac45a6bf03e93d503f4d89 in term 1.
14:27:04.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.753870 23900 leader_election.cc:304] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5615ae745041414ab387d8f10a17a5cc, f0c77e5128ac45a6bf03e93d503f4d89; no voters: 
14:27:04.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.754663 24265 raft_consensus.cc:2804] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 1 FOLLOWER]: Leader election won for term 1
14:27:04.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.756430 24265 raft_consensus.cc:697] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [term 1 LEADER]: Becoming Leader. State: Replica: f0c77e5128ac45a6bf03e93d503f4d89, State: Running, Role: LEADER
14:27:04.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.757403 24265 consensus_queue.cc:237] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } }
14:27:04.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:04.771117 23373 catalog_manager.cc:5697] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0c77e5128ac45a6bf03e93d503f4d89 (127.22.199.194). New cstate: current_term: 1 leader_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0c77e5128ac45a6bf03e93d503f4d89" member_type: VOTER last_known_addr { host: "127.22.199.194" port: 38423 } health_report { overall_health: HEALTHY } } }
14:27:04.781 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:27:04.782 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:27:04.782 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:27:04.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:04.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:04.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:04.782 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:04.782 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:04.782 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:04.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:04.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:04.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:04.785 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:27:04.874 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:04.874 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:04.874 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:04.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:04.874 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:04.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:04.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:04.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:04.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:04.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:04.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:04.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:04.875 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:04.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:04.998 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:04.998 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:04.998 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:04.998 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.998 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.999 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:04.999 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.999 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.999 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.999 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.999 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:04.999 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:04.999 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:05.021 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:05.021 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:05.021 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:05.021 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.022 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.022 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.022 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.022 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:05.034 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:05.034 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:05.034 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:05.035 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.035 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.035 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.035 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.035 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:05.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.138 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:05.139 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:05.139 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:05.139 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:05.139 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:05.139 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:05.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:05.139 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:05.139 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:05.139 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:05.139 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:05.139 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:05.139 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:05.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:05.201545 24265 consensus_queue.cc:1048] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e402b58e1e52489f83db8181e5bd0d5a" member_type: VOTER last_known_addr { host: "127.22.199.195" port: 36379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:27:05.219 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.61:40633(127.21.234.61:40633)] disconnecting while in state READY
14:27:05.219 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.60:44393(127.21.234.60:44393)] disconnecting while in state READY
14:27:05.219 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.62:34045(127.21.234.62:34045)] disconnecting while in state READY
14:27:05.220 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.234.61:40633(127.21.234.61:40633)] handling channelInactive
14:27:05.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state READY due to: connection closed
14:27:05.221 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:05.220 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.234.62:34045(127.21.234.62:34045)] handling channelInactive
14:27:05.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state READY due to: connection closed
14:27:05.223 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
14:27:05.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:05.222864 24268 consensus_queue.cc:1048] T 4fd4f47cde3f420fa3d9039dfd03f7c8 P f0c77e5128ac45a6bf03e93d503f4d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5615ae745041414ab387d8f10a17a5cc" member_type: VOTER last_known_addr { host: "127.22.199.193" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:27:05.225 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
14:27:05.241 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:05.241 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:05.241 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:05.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.242 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.242 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.242 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.242 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:05.271 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.253:33945(127.22.199.253:33945)] disconnecting while in state READY
14:27:05.271 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.234.60:44393(127.21.234.60:44393)] handling channelInactive
14:27:05.271 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.254:42535(127.22.199.254:42535)] disconnecting while in state READY
14:27:05.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state READY due to: connection closed
14:27:05.271 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.252:43961(127.22.199.252:43961)] disconnecting while in state READY
14:27:05.271 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
14:27:05.271 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:05.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:05.271 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:05.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:05.272 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:05.273 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
14:27:05.273 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:27:05.274 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:05.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:05.275 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
14:27:05.276 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:27:05.277 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
14:27:05.277 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
14:27:05.277 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:27:05.277 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:27:05.277 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
14:27:05.285 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
14:27:05.285 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
14:27:05.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.545 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:05.546 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:05.546 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:05.546 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:05.546 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:05.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:05.549 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
14:27:05.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:05.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:05.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:05.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:05.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:05.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:05.550 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:05.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:05.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:05.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:05.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:05.567 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:05.567 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:05.567 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:05.567 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:05.567 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:05.567 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:05.567 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:05.567 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:05.567 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:05.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.602 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
14:27:05.602 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
14:27:05.602 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
14:27:05.615 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:27:05.634 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:05.634 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:05.634 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:05.635 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.635 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:05.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:05.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.635 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.635 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:05.635 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:05.662 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:05.662 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:05.662 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:05.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.662 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.662 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.663 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.663 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:05.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.854 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:05.855 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:05.855 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:05.855 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.855 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.855 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.856 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.856 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.856 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:05.894 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:05.894 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:05.895 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:05.895 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.895 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.895 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:05.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:05.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:05.896 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:05.924 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:05.934 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:05.935 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:05.935 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:05.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:05.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.936 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:05.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:05.936 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:05.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.101 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.292 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:06.292 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:06.292 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:06.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:06.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:06.293 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:06.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:06.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:06.293 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:06.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:06.293 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:06.293 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:06.293 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:06.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:06.320 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:06.320 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:06.320 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.320 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.320 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.320 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.320 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.320 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.320 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.320 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.320 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.320 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:06.321 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:27:06.321 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:27:06.321 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:27:06.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:06.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:06.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:06.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:06.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:06.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:06.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:06.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:06.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:06.323 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:27:06.335 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
14:27:06.337 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:06.337 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:06.337 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:06.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.338 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.338 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.338 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.338 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.338 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.338 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.338 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:06.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:06.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:06.397 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:06.397 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.397 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.397 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:06.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:06.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:06.398 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:06.420 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:06.421 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:06.421 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:06.421 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:06.421 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:06.421 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:06.421 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:06.421 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:06.421 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:06.421 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:06.421 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:06.421 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:06.421 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:06.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.454 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:06.454 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:06.454 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:06.454 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.455 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:06.456 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28373), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [50ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [57ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [66ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [134ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [135ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [136ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [149ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [149ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [189ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [190ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [191ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [262ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [283ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [283ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [541ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [542ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [641ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1442ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2123ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [4022ms] refreshing cache from master, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4023ms] too many traces: truncated at 100 traces, deferred=Deferred@876522554(state=PENDING, result=null, callback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968), errback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968)))
14:27:06.457 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:27:06.457 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28373), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [50ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [57ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [66ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [134ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [135ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [136ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [149ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [149ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [189ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [190ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [191ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [262ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [283ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [283ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [541ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [542ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [641ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1442ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2123ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [4022ms] refreshing cache from master, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4023ms] too many traces: truncated at 100 traces, deferred=Deferred@876522554(state=PENDING, result=null, callback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968), errback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:06.457 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
14:27:06.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.459 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:27:06.460 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
14:27:06.461 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28373), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [50ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [57ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [66ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [134ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [135ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [136ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [149ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [149ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [189ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [190ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [191ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [191ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [202ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [203ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [222ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [222ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [262ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [283ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [283ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [541ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [542ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [542ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [641ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [642ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1442ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2123ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [4022ms] refreshing cache from master, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4023ms] too many traces: truncated at 100 traces, deferred=Deferred@876522554(state=PENDING, result=null, callback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968), errback=(continuation of Deferred@1405203779 after retry RPC after error@1049409110) -> (continuation of Deferred@450742027 after retry RPC after error@1531180822) -> (continuation of Deferred@100022928 after retry RPC after error@1586696830) -> (continuation of Deferred@704803640 after retry RPC after error@1857935913) -> (continuation of Deferred@1521180628 after retry RPC after error@485336605) -> (continuation of Deferred@634363147 after retry RPC after error@631465737) -> (continuation of Deferred@628541846 after retry RPC after error@1415204459) -> (continuation of Deferred@220505646 after retry RPC after error@864097196) -> (continuation of Deferred@547903027 after retry RPC after error@638020955) -> (continuation of Deferred@238729827 after retry RPC after error@891143291) -> (continuation of Deferred@1466303781 after retry RPC after error@1251395367) -> (continuation of Deferred@287606196 after retry RPC after error@1245816311) -> (continuation of Deferred@770297527 after retry RPC after error@1371179986) -> (continuation of Deferred@1686547828 after retry RPC after error@598725134) -> (continuation of Deferred@1087388858 after retry RPC after error@1169283945) -> (continuation of Deferred@336409510 after retry RPC after error@1232055435) -> (continuation of Deferred@136019184 after retry RPC after error@1136296969) -> (continuation of Deferred@1045893083 after retry RPC after error@174647150) -> (continuation of Deferred@1497888303 after retry RPC after error@1321905090) -> (continuation of Deferred@1222990871 after retry RPC after error@91984370) -> (continuation of Deferred@1676409340 after retry RPC after error@2019871480) -> (continuation of Deferred@436417543 after retry RPC after error@1135530676) -> (continuation of Deferred@2134308644 after retry RPC after error@568049968)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:06.462 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:27:06.462 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
14:27:06.463 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
14:27:06.463 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RUNNING to RESTARTING.
14:27:06.473 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
14:27:06.486 [INFO - flink-metrics-4] (Slf4jLogger.scala:117) Slf4jLogger started
14:27:06.495 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
14:27:06.506 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
14:27:06.511 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
14:27:06.512 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
14:27:06.512 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
14:27:06.512 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
14:27:06.513 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
14:27:06.513 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
14:27:06.513 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
14:27:06.513 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:27:06.513 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:27:06.513 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:27:06.514 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:27:06.514 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:27:06.514 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:27:06.514 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
14:27:06.514 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
14:27:06.514 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
14:27:06.514 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
14:27:06.514 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
14:27:06.514 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
14:27:06.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:06.515 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
14:27:06.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:06.515 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
14:27:06.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.515 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.515 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:06.515 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
14:27:06.515 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
14:27:06.515 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
14:27:06.516 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.516 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.516 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.516 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_3f501f8dea5e249a6e3949684b97ea53/blobStorage
14:27:06.516 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:06.516 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:37339 - max concurrent requests: 50 - max backlog: 1000
14:27:06.517 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3f501f8dea5e249a6e3949684b97ea53/blobStorage
14:27:06.517 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3f501f8dea5e249a6e3949684b97ea53/blobStorage
14:27:06.518 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
14:27:06.519 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: bf3280e6-7a66-4911-8924-cbab6d4e0590
14:27:06.520 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
14:27:06.521 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-14d7b809-ad8b-4b0f-8c89-236f85752d91
14:27:06.522 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-ae26bfc7-4784-4be4-8083-5aae75140f80
14:27:06.579 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
14:27:06.580 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
14:27:06.580 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
14:27:06.580 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
14:27:06.581 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
14:27:06.582 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_24 .
14:27:06.587 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
14:27:06.587 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-2cc79a12-7579-4949-8da7-d55212db2e38
14:27:06.588 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
14:27:06.588 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
14:27:06.598 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
14:27:06.598 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
14:27:06.602 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:36565
14:27:06.602 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
14:27:06.603 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:36565 was granted leadership with leaderSessionID=66e609cc-53e7-4c3d-a48b-97749dff445b
14:27:06.604 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:36565 , session=66e609cc-53e7-4c3d-a48b-97749dff445b
14:27:06.605 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
14:27:06.612 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
14:27:06.613 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 1a8e480c-3223-469a-a8e4-bffc4702fcd8. Creating new DispatcherLeaderProcess.
14:27:06.613 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
14:27:06.613 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
14:27:06.614 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:06.614 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:06.614 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:06.614 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.622 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.622 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.622 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.622 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:06.626 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
14:27:06.626 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
14:27:06.626 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
14:27:06.627 [INFO - pool-519-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 58b8c869-e89b-4cff-a3e0-0a0c254d515a.
14:27:06.628 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_25 .
14:27:06.630 [INFO - pool-519-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_26 .
14:27:06.638 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
14:27:06.638 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
14:27:06.638 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
14:27:06.639 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
14:27:06.639 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
14:27:06.639 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_26 , session=58b8c869-e89b-4cff-a3e0-0a0c254d515a
14:27:06.640 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_25 , session=1a8e480c-3223-469a-a8e4-bffc4702fcd8
14:27:06.641 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(a3e00a0c254d515a58b8c869e89b4cff).
14:27:06.667 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:27:06.672 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.672 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1080) Registering TaskManager with ResourceID bf3280e6-7a66-4911-8924-cbab6d4e0590 (pekko://flink/user/rpc/taskmanager_24) at ResourceManager
14:27:06.672 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.673 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-6a397d5027a7b18c1b9ef5e0a2e2b4bf'.
14:27:06.673 [INFO - mini-cluster-io-thread-2] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf was granted leadership with leader id 7449da46-bbcf-4b32-911c-47c1df74cf1f. Creating new JobMasterServiceProcess.
14:27:06.673 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_26 under registration id 45db677a87d93b48b2914c24eef3d663.
14:27:06.674 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor bf3280e6-7a66-4911-8924-cbab6d4e0590 under 45db677a87d93b48b2914c24eef3d663 at the slot manager.
14:27:06.676 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_27 .
14:27:06.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.679 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.680 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.681 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph ae65c0b7aa8e98ba865d6939a3a1cc01 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.681 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:06.681 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.681 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:06.681 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
14:27:06.681 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:06.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:06.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:06.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.681 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:06.682 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:06.682 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
14:27:06.683 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@47ddb08b
14:27:06.683 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:06.683 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11571379102389981638/checkpoints")
14:27:06.684 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
14:27:06.684 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@5dd0384b for Flink Streaming Job (6a397d5027a7b18c1b9ef5e0a2e2b4bf).
14:27:06.684 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_27 , session=7449da46-bbcf-4b32-911c-47c1df74cf1f
14:27:06.685 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (6a397d5027a7b18c1b9ef5e0a2e2b4bf) under job master id 911c47c1df74cf1f7449da46bbcf4b32.
14:27:06.685 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:27:06.687 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.687 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
14:27:06.688 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6a397d5027a7b18c1b9ef5e0a2e2b4bf) switched from state CREATED to RUNNING.
14:27:06.689 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
14:27:06.690 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:06.690 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
14:27:06.690 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:06.690 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
14:27:06.690 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:06.691 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
14:27:06.691 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(a3e00a0c254d515a58b8c869e89b4cff)
14:27:06.692 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.234.62:34045(127.21.234.62:34045)] Successfully connected to peer
14:27:06.692 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.234.61:40633(127.21.234.61:40633)] Successfully connected to peer
14:27:06.693 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.62
14:27:06.694 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
14:27:06.694 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.61
14:27:06.694 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:390) Registering job manager 911c47c1df74cf1f7449da46bbcf4b32@pekko://flink/user/rpc/jobmanager_27 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.697 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.234.60:44393(127.21.234.60:44393)] Successfully connected to peer
14:27:06.701 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.60
14:27:06.702 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.704 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager 911c47c1df74cf1f7449da46bbcf4b32@pekko://flink/user/rpc/jobmanager_27 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.705 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a3e00a0c254d515a58b8c869e89b4cff.
14:27:06.706 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6a397d5027a7b18c1b9ef5e0a2e2b4bf: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:27:06.708 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcb343aab, L:/127.0.0.1:60536 - R:/127.21.234.61:40633] using SASL/PLAIN
14:27:06.708 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.709 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.710 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4dc4a32e, L:/127.0.0.1:48468 - R:/127.21.234.62:34045] using SASL/PLAIN
14:27:06.716 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x787b138e, L:/127.0.0.1:59508 - R:/127.21.234.60:44393] using SASL/PLAIN
14:27:06.719 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.719 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=31), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.62:34045, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.61:40633, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.60:44393, [22ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.61:40633: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.62:34045: OK, [29ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.60:44393: OK, deferred=null) after lookup
14:27:06.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:06.727 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1dd0f745fcce4200bdd168b6ce87370a for table 'replication_test_table' with partition [<start>, <end>)
14:27:06.727 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127),e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)[L],e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:06.729 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:06.730 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:06.730 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:06.730 [DEBUG - main] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:06.732 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:06.733 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:06.734 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:06.745 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 6a397d5027a7b18c1b9ef5e0a2e2b4bf
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager bf3280e6-7a66-4911-8924-cbab6d4e0590
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
14:27:06.746 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 94903b7cd1ac9efdda221579ff5de4ab from bf3280e6-7a66-4911-8924-cbab6d4e0590 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.746 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c593af49472d4eaf9b74a3ce147d9dc9 from bf3280e6-7a66-4911-8924-cbab6d4e0590 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.747 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 94903b7cd1ac9efdda221579ff5de4ab for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf from resource manager with leader id a3e00a0c254d515a58b8c869e89b4cff.
14:27:06.747 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 94903b7cd1ac9efdda221579ff5de4ab with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.747 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job 6a397d5027a7b18c1b9ef5e0a2e2b4bf for job leader monitoring.
14:27:06.748 [INFO - mini-cluster-io-thread-2] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_27 with leader id 7449da46-bbcf-4b32-911c-47c1df74cf1f.
14:27:06.749 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
14:27:06.751 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_27 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.752 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1783) Establish JobManager connection for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.752 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.752 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.253
14:27:06.752 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
14:27:06.753 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to bf3280e6-7a66-4911-8924-cbab6d4e0590 @ 127.0.0.1 (dataPort=-1) with allocation id 94903b7cd1ac9efdda221579ff5de4ab
14:27:06.753 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 94903b7cd1ac9efdda221579ff5de4ab.
14:27:06.754 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:06.754 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.754 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
14:27:06.755 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 6a397d5027a7b18c1b9ef5e0a2e2b4bf
14:27:06.756 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 94903b7cd1ac9efdda221579ff5de4ab.
14:27:06.756 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot bb4f9ca977d6d91f2987114488f05821 from bf3280e6-7a66-4911-8924-cbab6d4e0590 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.757 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d40264f4776dbf8cbfe83010a0e100fd from bf3280e6-7a66-4911-8924-cbab6d4e0590 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.758 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.760 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
14:27:06.760 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
14:27:06.760 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 94903b7cd1ac9efdda221579ff5de4ab.
14:27:06.760 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request c593af49472d4eaf9b74a3ce147d9dc9 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf from resource manager with leader id a3e00a0c254d515a58b8c869e89b4cff.
14:27:06.760 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for c593af49472d4eaf9b74a3ce147d9dc9 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.761 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1090096f, L:/127.0.0.1:37008 - R:/127.22.199.253:33945] using SASL/PLAIN
14:27:06.761 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
14:27:06.762 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to bf3280e6-7a66-4911-8924-cbab6d4e0590 @ 127.0.0.1 (dataPort=-1) with allocation id c593af49472d4eaf9b74a3ce147d9dc9
14:27:06.763 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35551d2f
14:27:06.763 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request bb4f9ca977d6d91f2987114488f05821 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf from resource manager with leader id a3e00a0c254d515a58b8c869e89b4cff.
14:27:06.763 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:06.763 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11571379102389981638/checkpoints")
14:27:06.764 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:27:06.764 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.765 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
14:27:06.765 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for bb4f9ca977d6d91f2987114488f05821 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.765 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.766 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request d40264f4776dbf8cbfe83010a0e100fd for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf from resource manager with leader id a3e00a0c254d515a58b8c869e89b4cff.
14:27:06.766 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for d40264f4776dbf8cbfe83010a0e100fd with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
14:27:06.766 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:06.767 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c593af49472d4eaf9b74a3ce147d9dc9.
14:27:06.767 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd0763df8, L:/127.0.0.1:46726 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:06.767 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
14:27:06.767 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to bf3280e6-7a66-4911-8924-cbab6d4e0590 @ 127.0.0.1 (dataPort=-1) with allocation id bb4f9ca977d6d91f2987114488f05821
14:27:06.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
14:27:06.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to bf3280e6-7a66-4911-8924-cbab6d4e0590 @ 127.0.0.1 (dataPort=-1) with allocation id d40264f4776dbf8cbfe83010a0e100fd
14:27:06.771 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.771 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=44), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, [34ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.253:33945: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, deferred=null) after lookup
14:27:06.772 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id c593af49472d4eaf9b74a3ce147d9dc9.
14:27:06.773 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.775 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3de847eb, L:/127.0.0.1:36950 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:06.775 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot bb4f9ca977d6d91f2987114488f05821.
14:27:06.775 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c593af49472d4eaf9b74a3ce147d9dc9.
14:27:06.775 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot d40264f4776dbf8cbfe83010a0e100fd.
14:27:06.775 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
14:27:06.775 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot bb4f9ca977d6d91f2987114488f05821.
14:27:06.775 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
14:27:06.776 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.777 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id bb4f9ca977d6d91f2987114488f05821.
14:27:06.778 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@600c24d8
14:27:06.778 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:06.778 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11571379102389981638/checkpoints")
14:27:06.778 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:27:06.778 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
14:27:06.781 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 for table 'replication_test_table' with partition [<start>, <end>)
14:27:06.781 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8@[5615ae745041414ab387d8f10a17a5cc(127.22.199.193:34781),e402b58e1e52489f83db8181e5bd0d5a(127.22.199.195:36379),f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)[L]]}]
14:27:06.781 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28a23453
14:27:06.781 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50d6ba48
14:27:06.781 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.199.254:42535, [5ms] Sub RPC GetTableLocations: received response from server master-127.22.199.254:42535: OK, deferred=null)) after lookup
14:27:06.781 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] connecting to peer
14:27:06.788 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot d40264f4776dbf8cbfe83010a0e100fd.
14:27:06.788 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
14:27:06.788 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
14:27:06.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@56782649
14:27:06.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:06.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11571379102389981638/checkpoints")
14:27:06.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:27:06.791 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
14:27:06.791 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id d40264f4776dbf8cbfe83010a0e100fd.
14:27:06.791 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.793 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.793 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7af31ff9
14:27:06.794 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.799 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] Successfully connected to peer
14:27:06.803 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
14:27:06.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
14:27:06.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ccc1805
14:27:06.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:06.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11571379102389981638/checkpoints")
14:27:06.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:27:06.807 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
14:27:06.810 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:06.810 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:06.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:06.812 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:06.813 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f26623
14:27:06.813 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:06.814 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:06.815 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:06.816 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:06.821 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:06.822 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:06.825 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:06.826 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.830 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.831 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.836 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x361f21c0, L:/127.0.0.1:46728 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:06.838 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.840 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:06.840 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x5e71342a, L:/127.0.0.1:33674 - R:/127.22.199.194:38423] using TOKEN/null
14:27:06.841 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:06.842 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:06.842 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4c7a9d53, L:/127.0.0.1:36952 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:06.850 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:06.853 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:06.855 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:06.856 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:06.857 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:06.857 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:06.858 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.22.199.254:42535(127.22.199.254:42535)] connecting to peer
14:27:06.860 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.860 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=68), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [29ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, deferred=null) after lookup
14:27:06.860 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:06.861 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:06.864 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.864 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:06.865 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:06.868 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.869 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:06.870 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ecd5198
14:27:06.871 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
14:27:06.872 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
14:27:06.873 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.22.199.252:43961(127.22.199.252:43961)] connecting to peer
14:27:06.873 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.199.254:42535(127.22.199.254:42535)] Successfully connected to peer
14:27:06.874 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaea235fb, L:/127.0.0.1:46746 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:06.878 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.878 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=84), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, [66ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, deferred=null) after lookup
14:27:06.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.886 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.887 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.887 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c3ec0b
14:27:06.889 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
14:27:06.889 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
14:27:06.890 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xfc33dfe7, L:/127.0.0.1:36976 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:06.892 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.893 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.253
14:27:06.896 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:27:06.897 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.254
14:27:06.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1fc842166b10bf37d4028602fcfc536430e47532576f4eb758f95438ffcb6d23'}]
14:27:06.898 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:06.903 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.909 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:06.910 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3a2b8ca7, L:/127.0.0.1:46740 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:06.913 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.913 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=120), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, [38ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.252:43961: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, deferred=null) after lookup
14:27:06.916 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.916 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x22984672, L:/127.0.0.1:37014 - R:/127.22.199.253:33945] using TOKEN/null
14:27:06.920 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.920 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.253
14:27:06.923 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.924 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.924 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4f17af1, L:/127.0.0.1:46760 - R:/127.22.199.254:42535] using SASL/PLAIN
14:27:06.928 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x74e7d817, L:/127.0.0.1:37020 - R:/127.22.199.253:33945] using SASL/PLAIN
14:27:06.929 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.931 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:27:06.933 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.933 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2d16614a
14:27:06.934 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:06.934 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:06.934 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:06.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
14:27:06.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.934 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:06.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:06.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:06.935 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:06.936 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [41ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [64ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [65ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [243ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [254ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [255ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [255ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [270ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [275ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [276ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [302ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [303ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [303ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [323ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [324ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [423ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [481ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [643ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [643ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [961ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [962ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1721ms] refreshing cache from master, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3481ms] refreshing cache from master, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [4340ms] refreshing cache from master, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4341ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871)))
14:27:06.936 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:27:06.937 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf050a912, L:/127.0.0.1:36962 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:06.937 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [41ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [64ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [65ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [243ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [254ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [255ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [255ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [270ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [275ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [276ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [302ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [303ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [303ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [323ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [324ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [423ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [481ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [643ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [643ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [961ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [962ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1721ms] refreshing cache from master, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3481ms] refreshing cache from master, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [4340ms] refreshing cache from master, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4341ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:06.937 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
14:27:06.939 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:27:06.940 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [41ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [64ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [65ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [65ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [243ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [254ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [255ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [255ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [270ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [275ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [276ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [276ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [302ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [303ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [303ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [323ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [324ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [324ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [422ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [423ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [481ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [642ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [643ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [643ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [961ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [962ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [962ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1721ms] refreshing cache from master, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1723ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3481ms] refreshing cache from master, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [3482ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [3482ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [4340ms] refreshing cache from master, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [4341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [4341ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:06.941 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
14:27:06.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
14:27:06.942 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:27:06.946 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.948 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbb87c961, L:/127.0.0.1:37022 - R:/127.22.199.253:33945] using SASL/PLAIN
14:27:06.952 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:27:06.952 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.22.199.253:33945(127.22.199.253:33945)] connecting to peer
14:27:06.953 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.199.252:43961(127.22.199.252:43961)] Successfully connected to peer
14:27:06.953 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299997, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)[L],e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667),e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:06.955 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.199.252
14:27:06.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:06.961 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:06.961 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=129), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.254:42535, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.252:43961, [71ms] Sub RPC ConnectToMaster: received response from server master-127.22.199.254:42535: OK, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.199.253:33945, deferred=null) after lookup
14:27:06.962 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.199.253:33945(127.22.199.253:33945)] Successfully connected to peer
14:27:06.965 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.965 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:06.967 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:06.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@26e7fa40
14:27:06.968 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.971 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3cebd780, L:/127.0.0.1:36986 - R:/127.22.199.252:43961] using SASL/PLAIN
14:27:06.971 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:27:06.979 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:06.981 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdba7a84f, L:/127.0.0.1:37028 - R:/127.22.199.253:33945] using TOKEN/null
14:27:06.995 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] connecting to peer
14:27:06.996 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
14:27:06.997 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
14:27:06.997 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
14:27:06.997 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
14:27:06.997 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
14:27:07.014 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:27:07.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.038 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
14:27:07.038 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae65c0b7aa8e98ba865d6939a3a1cc01_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
14:27:07.039 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] Successfully connected to peer
14:27:07.050 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.3
14:27:07.052 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.052 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.052 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.053 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.053 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.053 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.053 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.071 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:07.077 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114427076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:07.079 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.084 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc0a03205, L:/127.0.0.1:55030 - R:/127.21.234.3:42127] using SASL/PLAIN
14:27:07.102 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1955 bytes, checkpointDuration=26 ms, finalizationTime=0 ms).
14:27:07.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
14:27:07.118 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false, responseScanTimestamp = 7287252691714048001) for scanner KuduScanner(table=replication_test_table, tablet=1dd0f745fcce4200bdd168b6ce87370a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.119 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [1fc842166b10bf37d4028602fcfc536430e47532576f4eb758f95438ffcb6d23]
14:27:07.120 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
14:27:07.137 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.145 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 for table 'replication_test_table' with partition [<start>, <end>)
14:27:07.145 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8@[5615ae745041414ab387d8f10a17a5cc(127.22.199.193:34781),e402b58e1e52489f83db8181e5bd0d5a(127.22.199.195:36379),f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)[L]]}]
14:27:07.147 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd4f47cde3f420fa3d9039dfd03f7c8 for table 'replication_test_table' with partition [<start>, <end>)
14:27:07.147 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8@[5615ae745041414ab387d8f10a17a5cc(127.22.199.193:34781),e402b58e1e52489f83db8181e5bd0d5a(127.22.199.195:36379),f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)[L]]}]
14:27:07.167 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1fc842166b10bf37d4028602fcfc536430e47532576f4eb758f95438ffcb6d23]
14:27:07.167 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:27:07.168 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:27:07.168 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] disconnecting while in state READY
14:27:07.168 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1fc842166b10bf37d4028602fcfc536430e47532576f4eb758f95438ffcb6d23 finished by subtask 0; deferring removal (restored in pending)
14:27:07.169 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:07.173 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.173 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.173 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.173 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.173 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.174 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.174 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.174 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.174 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.174 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.174 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.174 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.179 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] handling channelInactive
14:27:07.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] cleaning up while in state READY due to: connection closed
14:27:07.179 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:27:07.179 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:27:07.193 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.259 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.316 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:07.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:07.319 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:07.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.345 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:07.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.345 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:07.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.345 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:07.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.345 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:07.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.346 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.346 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:07.371 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.388 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:07.388 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:07.388 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:07.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.389 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:07.390 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29215), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [49ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [51ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [85ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [87ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [88ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [89ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [119ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [125ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [242ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [281ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [282ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [302ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [823ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [863ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2082ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [5541ms] refreshing cache from master, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [5542ms] too many traces: truncated at 100 traces, deferred=Deferred@39177908(state=PENDING, result=null, callback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634), errback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634)))
14:27:07.391 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:27:07.391 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29215), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [49ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [51ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [85ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [87ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [88ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [89ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [119ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [125ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [242ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [281ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [282ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [302ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [823ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [863ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2082ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [5541ms] refreshing cache from master, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [5542ms] too many traces: truncated at 100 traces, deferred=Deferred@39177908(state=PENDING, result=null, callback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634), errback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.254:35143
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:07.392 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
14:27:07.396 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:27:07.401 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29215), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [49ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [51ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [51ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [85ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [87ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [88ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [89ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [119ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [124ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [125ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [141ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [141ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [161ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [162ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [162ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [201ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [201ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [242ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [242ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [281ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [282ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [282ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [302ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [822ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [823ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [823ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [862ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [863ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2082ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [5541ms] refreshing cache from master, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [5542ms] too many traces: truncated at 100 traces, deferred=Deferred@39177908(state=PENDING, result=null, callback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634), errback=(continuation of Deferred@1001967547 after retry RPC after error@227827361) -> (continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.254:35143
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:07.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
14:27:07.402 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:27:07.402 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
14:27:07.426 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.429 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.486 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.541 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114427576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:07.579 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=10, operationSize=1800, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3ad1dbc4, flushNotification=Deferred@2057544775(state=PENDING, result=null, callback=<none>, errback=<none>)}
14:27:07.580 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] connecting to peer
14:27:07.583 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] Successfully connected to peer
14:27:07.597 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.615 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:07.615 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:07.615 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:07.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.616 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:07.628 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:07.635 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x07111873, L:/127.0.0.1:33676 - R:/127.22.199.194:38423] using TOKEN/null
14:27:07.653 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.679 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:07.679 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:07.679 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:07.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:07.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:07.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:07.681 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:07.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.728 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1955 bytes, checkpointDuration=151 ms, finalizationTime=0 ms).
14:27:07.729 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
14:27:07.729 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 1fc842166b10bf37d4028602fcfc536430e47532576f4eb758f95438ffcb6d23 from pending
14:27:07.729 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 1 finished splits from enumerator state
14:27:07.750 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:07.750 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:07.750 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:07.750 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.750 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.750 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.750 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.750 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.750 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.751 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:07.779 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.783 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:07.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1dd0f745fcce4200bdd168b6ce87370a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.809 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8f80318a90fd416c8a7cd6a0165ea9d0
14:27:07.834 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd4f47cde3f420fa3d9039dfd03f7c8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:07.836 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.253:33945(127.22.199.253:33945)] disconnecting while in state READY
14:27:07.837 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.254:42535(127.22.199.254:42535)] disconnecting while in state READY
14:27:07.837 [DEBUG - main] (Connection.java:575) [peer master-127.22.199.252:43961(127.22.199.252:43961)] disconnecting while in state READY
14:27:07.837 [DEBUG - main] (Connection.java:575) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] disconnecting while in state READY
14:27:07.838 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:07.838 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:07.841 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:07.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:07.843 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:07.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:07.847 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:07.848 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:27:07.848 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
14:27:07.848 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
14:27:07.858 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] handling channelInactive
14:27:07.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] cleaning up while in state READY due to: connection closed
14:27:07.859 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
14:27:07.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:07.859802 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23621
14:27:07.892 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.892 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.892 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.893 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.893 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.894 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [171ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [272ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [275ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [275ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [293ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [298ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [299ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [299ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [321ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [361ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [381ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [462ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [462ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [500ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [501ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [942ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [942ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1022ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4375ms] refreshing cache from master, [4375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [4378ms] too many traces: truncated at 100 traces, deferred=Deferred@2003485272(state=PENDING, result=null, callback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125), errback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125)))
14:27:07.897 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.897 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.897 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.898 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.898 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.898 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.898 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [171ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [272ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [275ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [275ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [293ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [298ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [299ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [299ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [321ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [361ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [381ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [462ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [462ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [500ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [501ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [942ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [942ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1022ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4375ms] refreshing cache from master, [4375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [4378ms] too many traces: truncated at 100 traces, deferred=Deferred@2003485272(state=PENDING, result=null, callback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125), errback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [171ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [272ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [275ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [275ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [293ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [298ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [299ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [299ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [321ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [361ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [381ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [462ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [462ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [500ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [501ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [942ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [942ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1022ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4375ms] refreshing cache from master, [4375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [4378ms] too many traces: truncated at 100 traces, deferred=Deferred@2003485272(state=PENDING, result=null, callback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125), errback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:07.899 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.899 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.899 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.899 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:07.958101 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23827
14:27:07.965 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:07.965 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:07.965 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:07.966 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.966 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.966 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.966 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.966 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.966 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:07.966 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:07.966 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:07.967 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:07.967 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.967 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:07.967 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.967 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.967 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.968 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.968 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.968 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:07.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:07.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:07.969 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:07.972 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.972 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.972 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.972 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.973 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.973 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:07.974 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:07.975 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29851), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [69ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [70ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [76ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [76ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [164ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [166ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [167ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [167ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [214ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [215ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [216ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [216ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [240ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [241ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [262ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [302ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [321ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [322ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [521ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [522ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [522ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [522ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1022ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1042ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1780ms] refreshing cache from master, [1780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1781ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1782ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2180ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2182ms] too many traces: truncated at 100 traces, deferred=Deferred@1874859371(state=PENDING, result=null, callback=(continuation of Deferred@719045284 after retry RPC after error@1427272470) -> (continuation of Deferred@1252818605 after retry RPC after error@631787998) -> (continuation of Deferred@1368553773 after retry RPC after error@392047306) -> (continuation of Deferred@1043232666 after retry RPC after error@1500505888) -> (continuation of Deferred@460764721 after retry RPC after error@2098780143) -> (continuation of Deferred@810024305 after retry RPC after error@381110974) -> (continuation of Deferred@945725799 after retry RPC after error@63094316) -> (continuation of Deferred@207714128 after retry RPC after error@548355800) -> (continuation of Deferred@1840768563 after retry RPC after error@2064782967) -> (continuation of Deferred@2085500338 after retry RPC after error@634293533) -> (continuation of Deferred@1998221801 after retry RPC after error@475033811) -> (continuation of Deferred@289285454 after retry RPC after error@1086972945) -> (continuation of Deferred@1693991128 after retry RPC after error@2066834044) -> (continuation of Deferred@465910785 after retry RPC after error@337885700) -> (continuation of Deferred@855361240 after retry RPC after error@1118396537) -> (continuation of Deferred@1891531033 after retry RPC after error@2034507408) -> (continuation of Deferred@358996582 after retry RPC after error@482789915) -> (continuation of Deferred@523443755 after retry RPC after error@1188705219) -> (continuation of Deferred@2111268756 after retry RPC after error@1475083303) -> (continuation of Deferred@1353609911 after retry RPC after error@1199376202) -> (continuation of Deferred@30417910 after retry RPC after error@164818223) -> (continuation of Deferred@709500264 after retry RPC after error@94509116) -> (continuation of Deferred@99435757 after retry RPC after error@466123498) -> (continuation of Deferred@1637057958 after retry RPC after error@1961165392) -> (continuation of Deferred@465631757 after retry RPC after error@1132973237) -> (continuation of Deferred@1044697046 after retry RPC after error@1651490252), errback=(continuation of Deferred@719045284 after retry RPC after error@1427272470) -> (continuation of Deferred@1252818605 after retry RPC after error@631787998) -> (continuation of Deferred@1368553773 after retry RPC after error@392047306) -> (continuation of Deferred@1043232666 after retry RPC after error@1500505888) -> (continuation of Deferred@460764721 after retry RPC after error@2098780143) -> (continuation of Deferred@810024305 after retry RPC after error@381110974) -> (continuation of Deferred@945725799 after retry RPC after error@63094316) -> (continuation of Deferred@207714128 after retry RPC after error@548355800) -> (continuation of Deferred@1840768563 after retry RPC after error@2064782967) -> (continuation of Deferred@2085500338 after retry RPC after error@634293533) -> (continuation of Deferred@1998221801 after retry RPC after error@475033811) -> (continuation of Deferred@289285454 after retry RPC after error@1086972945) -> (continuation of Deferred@1693991128 after retry RPC after error@2066834044) -> (continuation of Deferred@465910785 after retry RPC after error@337885700) -> (continuation of Deferred@855361240 after retry RPC after error@1118396537) -> (continuation of Deferred@1891531033 after retry RPC after error@2034507408) -> (continuation of Deferred@358996582 after retry RPC after error@482789915) -> (continuation of Deferred@523443755 after retry RPC after error@1188705219) -> (continuation of Deferred@2111268756 after retry RPC after error@1475083303) -> (continuation of Deferred@1353609911 after retry RPC after error@1199376202) -> (continuation of Deferred@30417910 after retry RPC after error@164818223) -> (continuation of Deferred@709500264 after retry RPC after error@94509116) -> (continuation of Deferred@99435757 after retry RPC after error@466123498) -> (continuation of Deferred@1637057958 after retry RPC after error@1961165392) -> (continuation of Deferred@465631757 after retry RPC after error@1132973237) -> (continuation of Deferred@1044697046 after retry RPC after error@1651490252)))
14:27:07.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.976 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:07.976 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
14:27:07.976 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.977 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:07.976 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29851), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [69ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [70ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [76ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [76ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [164ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [166ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [167ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [167ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [214ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [215ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [216ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [216ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [240ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [241ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [241ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [261ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [262ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [262ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [301ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [302ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [321ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [322ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [322ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [361ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [362ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [362ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [521ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [522ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [522ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [522ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1022ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1042ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1780ms] refreshing cache from master, [1780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [1781ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.254:35143: Network error: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.252:44649: Network error: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.18.72.253:45261: Network error: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [1782ms] delaying RPC due to: Service unavailable: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261, [2180ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.254:35143, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.252:44649, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.18.72.253:45261, [2182ms] too many traces: truncated at 100 traces, deferred=Deferred@1874859371(state=PENDING, result=null, callback=(continuation of Deferred@719045284 after retry RPC after error@1427272470) -> (continuation of Deferred@1252818605 after retry RPC after error@631787998) -> (continuation of Deferred@1368553773 after retry RPC after error@392047306) -> (continuation of Deferred@1043232666 after retry RPC after error@1500505888) -> (continuation of Deferred@460764721 after retry RPC after error@2098780143) -> (continuation of Deferred@810024305 after retry RPC after error@381110974) -> (continuation of Deferred@945725799 after retry RPC after error@63094316) -> (continuation of Deferred@207714128 after retry RPC after error@548355800) -> (continuation of Deferred@1840768563 after retry RPC after error@2064782967) -> (continuation of Deferred@2085500338 after retry RPC after error@634293533) -> (continuation of Deferred@1998221801 after retry RPC after error@475033811) -> (continuation of Deferred@289285454 after retry RPC after error@1086972945) -> (continuation of Deferred@1693991128 after retry RPC after error@2066834044) -> (continuation of Deferred@465910785 after retry RPC after error@337885700) -> (continuation of Deferred@855361240 after retry RPC after error@1118396537) -> (continuation of Deferred@1891531033 after retry RPC after error@2034507408) -> (continuation of Deferred@358996582 after retry RPC after error@482789915) -> (continuation of Deferred@523443755 after retry RPC after error@1188705219) -> (continuation of Deferred@2111268756 after retry RPC after error@1475083303) -> (continuation of Deferred@1353609911 after retry RPC after error@1199376202) -> (continuation of Deferred@30417910 after retry RPC after error@164818223) -> (continuation of Deferred@709500264 after retry RPC after error@94509116) -> (continuation of Deferred@99435757 after retry RPC after error@466123498) -> (continuation of Deferred@1637057958 after retry RPC after error@1961165392) -> (continuation of Deferred@465631757 after retry RPC after error@1132973237) -> (continuation of Deferred@1044697046 after retry RPC after error@1651490252), errback=(continuation of Deferred@719045284 after retry RPC after error@1427272470) -> (continuation of Deferred@1252818605 after retry RPC after error@631787998) -> (continuation of Deferred@1368553773 after retry RPC after error@392047306) -> (continuation of Deferred@1043232666 after retry RPC after error@1500505888) -> (continuation of Deferred@460764721 after retry RPC after error@2098780143) -> (continuation of Deferred@810024305 after retry RPC after error@381110974) -> (continuation of Deferred@945725799 after retry RPC after error@63094316) -> (continuation of Deferred@207714128 after retry RPC after error@548355800) -> (continuation of Deferred@1840768563 after retry RPC after error@2064782967) -> (continuation of Deferred@2085500338 after retry RPC after error@634293533) -> (continuation of Deferred@1998221801 after retry RPC after error@475033811) -> (continuation of Deferred@289285454 after retry RPC after error@1086972945) -> (continuation of Deferred@1693991128 after retry RPC after error@2066834044) -> (continuation of Deferred@465910785 after retry RPC after error@337885700) -> (continuation of Deferred@855361240 after retry RPC after error@1118396537) -> (continuation of Deferred@1891531033 after retry RPC after error@2034507408) -> (continuation of Deferred@358996582 after retry RPC after error@482789915) -> (continuation of Deferred@523443755 after retry RPC after error@1188705219) -> (continuation of Deferred@2111268756 after retry RPC after error@1475083303) -> (continuation of Deferred@1353609911 after retry RPC after error@1199376202) -> (continuation of Deferred@30417910 after retry RPC after error@164818223) -> (continuation of Deferred@709500264 after retry RPC after error@94509116) -> (continuation of Deferred@99435757 after retry RPC after error@466123498) -> (continuation of Deferred@1637057958 after retry RPC after error@1961165392) -> (continuation of Deferred@465631757 after retry RPC after error@1132973237) -> (continuation of Deferred@1044697046 after retry RPC after error@1651490252)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.18.72.253:45261
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:07.977 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
14:27:07.978 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [171ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [272ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [275ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [275ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [293ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [298ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [299ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [299ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [321ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [361ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [381ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [462ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [462ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [500ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [501ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [942ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [942ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1022ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4375ms] refreshing cache from master, [4375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [4378ms] too many traces: truncated at 100 traces, deferred=Deferred@2003485272(state=PENDING, result=null, callback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125), errback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [35ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [171ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [171ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [272ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [275ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [275ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [293ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [298ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [299ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [299ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [321ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [321ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [361ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [361ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [381ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [381ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [462ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [462ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [500ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [501ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [501ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [941ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [942ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [942ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [1022ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2300ms] refreshing cache from master, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [2300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.62:37019: Network error: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.61:34199: Network error: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199, [2301ms] Sub RPC ConnectToMaster: received response from server master-127.17.128.60:42293: Network error: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [2301ms] delaying RPC due to: Service unavailable: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293, [4375ms] refreshing cache from master, [4375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.62:37019, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.61:34199, [4376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.128.60:42293, [4378ms] too many traces: truncated at 100 traces, deferred=Deferred@2003485272(state=PENDING, result=null, callback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125), errback=(continuation of Deferred@56506720 after retry RPC after error@923389923) -> (continuation of Deferred@1952407717 after retry RPC after error@1434846324) -> (continuation of Deferred@660710045 after retry RPC after error@1592657733) -> (continuation of Deferred@1371213429 after retry RPC after error@880481682) -> (continuation of Deferred@505691338 after retry RPC after error@811521124) -> (continuation of Deferred@966769852 after retry RPC after error@1428482456) -> (continuation of Deferred@1784237466 after retry RPC after error@744642881) -> (continuation of Deferred@1759279661 after retry RPC after error@449193607) -> (continuation of Deferred@986947032 after retry RPC after error@71660434) -> (continuation of Deferred@256080933 after retry RPC after error@605716820) -> (continuation of Deferred@33678674 after retry RPC after error@762830691) -> (continuation of Deferred@960576700 after retry RPC after error@1235290849) -> (continuation of Deferred@1149718002 after retry RPC after error@1461198534) -> (continuation of Deferred@1737260101 after retry RPC after error@649827415) -> (continuation of Deferred@1487775151 after retry RPC after error@1330937426) -> (continuation of Deferred@1270767017 after retry RPC after error@828203429) -> (continuation of Deferred@73935612 after retry RPC after error@1755472589) -> (continuation of Deferred@1363683685 after retry RPC after error@188885664) -> (continuation of Deferred@1312345854 after retry RPC after error@905406974) -> (continuation of Deferred@627342628 after retry RPC after error@1072251906) -> (continuation of Deferred@934158911 after retry RPC after error@957879725) -> (continuation of Deferred@1066652407 after retry RPC after error@1253005395) -> (continuation of Deferred@215364835 after retry RPC after error@1964699049) -> (continuation of Deferred@1413455255 after retry RPC after error@1684155011) -> (continuation of Deferred@1496214464 after retry RPC after error@2071700201) -> (continuation of Deferred@1400916788 after retry RPC after error@641947125)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.128.60:42293
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:07.979 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:27:07.980 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
14:27:07.980 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
14:27:07.981 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
14:27:07.985 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
14:27:07.986 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 01c353b3dfaac48d363fa91db2a11301
14:27:07.987 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1318) Discarding the results produced by task execution a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
14:27:07.993 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:07.993 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:07.993 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:07.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:07.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:07.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:07.994 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.001 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:08.001 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:08.001 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:08.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.002 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:08.006 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] handling channelInactive
14:27:08.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f0c77e5128ac45a6bf03e93d503f4d89(127.22.199.194:38423)] cleaning up while in state READY due to: connection closed
14:27:08.012 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.012 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.012 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.013 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:08.016556 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 24019
14:27:08.034 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.034 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.034 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.034 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.034 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.035 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.077 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114428076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:08.099 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
14:27:08.101 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
14:27:08.114 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.114 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.114 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.115 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.115 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.115 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:08.141754 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23339
14:27:08.172 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.173 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.173 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.173 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.174 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:08.174 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:08.174 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:08.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.175 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.175 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:08.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:08.182 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.199.254:42535(127.22.199.254:42535)] handling channelInactive
14:27:08.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.199.254:42535(127.22.199.254:42535)] cleaning up while in state READY due to: connection closed
14:27:08.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:08.191342 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23410
14:27:08.212 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.212 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.212 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.212 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.213 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.213 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.213 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.213 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.213 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.213 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.224 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:08.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:08.224 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:08.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:08.225 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:08.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:08.225 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.199.253:33945(127.22.199.253:33945)] handling channelInactive
14:27:08.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.199.253:33945(127.22.199.253:33945)] cleaning up while in state READY due to: connection closed
14:27:08.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:08.235342 23327 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23489
14:27:08.272 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:08.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:08.272 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:08.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:08.273 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:08.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:08.272 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.199.252:43961(127.22.199.252:43961)] handling channelInactive
14:27:08.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.199.252:43961(127.22.199.252:43961)] cleaning up while in state READY due to: connection closed
14:27:08.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:08.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:08.359 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:08.359 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.359 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.360 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:08.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:08.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:08.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:08.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.530 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:08.530 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.530 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.530 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:08.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:08.531 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:08.566 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:08.567 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:08.567 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:08.567 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:08.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:08.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:08.568 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:08.568 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:08.568 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:08.568 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:08.568 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:08.568 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:08.568 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:08.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114428576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:08.577 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:08.577 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:08.577 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:08.577 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.577 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.577 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:08.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:08.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:08.578 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:08.590 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
14:27:08.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
14:27:08.618 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:08.619 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:08.619 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:08.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.619 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:08.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:08.619 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.619 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:08.619 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:08.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.652 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.653 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.653 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.653 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.653 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.659 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (01c353b3dfaac48d363fa91db2a11301) switched from state RESTARTING to RUNNING.
14:27:08.660 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 01c353b3dfaac48d363fa91db2a11301 from Checkpoint 66 @ 1779114366685 for 01c353b3dfaac48d363fa91db2a11301 located at file:/tmp/junit12845694439211909930/checkpoints/01c353b3dfaac48d363fa91db2a11301/chk-66.
14:27:08.660 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
14:27:08.661 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:27:08.661 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
14:27:08.662 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:27:08.662 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
14:27:08.662 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 7e4df4c5072cc4cbd3d010fcf80896db
14:27:08.663 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
14:27:08.663 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 7e4df4c5072cc4cbd3d010fcf80896db.
14:27:08.663 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:27:08.664 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 7e4df4c5072cc4cbd3d010fcf80896db.
14:27:08.664 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
14:27:08.664 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id f637657deada1029ec0e73b52fd27482
14:27:08.665 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
14:27:08.666 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:27:08.666 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
14:27:08.666 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 6295e036bf819b517a25e7bc93bbccc6
14:27:08.667 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
14:27:08.667 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 01c353b3dfaac48d363fa91db2a11301: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:27:08.667 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
14:27:08.668 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 95249cf1-a357-42b1-9670-69fc4815c606 @ 127.0.0.1 (dataPort=-1) with allocation id 502ab7224a4d234d987b3014c28d82e3
14:27:08.668 [INFO - Thread-77] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:27:08.669 [DEBUG - Thread-77] (Connection.java:575) [peer master-127.17.128.60:42293(127.17.128.60:42293)] disconnecting while in state TERMINATED
14:27:08.669 [DEBUG - Thread-77] (Connection.java:575) [peer master-127.17.128.61:34199(127.17.128.61:34199)] disconnecting while in state TERMINATED
14:27:08.669 [DEBUG - Thread-77] (Connection.java:575) [peer master-127.17.128.62:37019(127.17.128.62:37019)] disconnecting while in state TERMINATED
14:27:08.669 [DEBUG - Thread-77] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:08.670 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot f637657deada1029ec0e73b52fd27482.
14:27:08.670 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id f637657deada1029ec0e73b52fd27482.
14:27:08.671 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
14:27:08.671 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
14:27:08.672 [INFO - Thread-77] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:27:08.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@68cd528f
14:27:08.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:08.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:27:08.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:27:08.673 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
14:27:08.673 [INFO - Thread-77] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:27:08.675 [DEBUG - Thread-77] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.675 [INFO - Thread-77] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:27:08.676 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 6295e036bf819b517a25e7bc93bbccc6.
14:27:08.677 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 6295e036bf819b517a25e7bc93bbccc6.
14:27:08.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54f9635f
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:27:08.678 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:27:08.679 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
14:27:08.681 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 502ab7224a4d234d987b3014c28d82e3.
14:27:08.682 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 502ab7224a4d234d987b3014c28d82e3.
14:27:08.683 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
14:27:08.683 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
14:27:08.684 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e58a08d
14:27:08.684 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fcb2a32
14:27:08.684 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
14:27:08.684 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
14:27:08.685 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7cef8ac8
14:27:08.685 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:08.685 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:27:08.685 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:27:08.685 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
14:27:08.692 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:08.694 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fa4486898fe0ec3499e874328ada1f46a9bf2e808f01ee26375e98f08780d4d9'}]
14:27:08.695 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.701 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5754fdbf
14:27:08.701 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:08.702 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12845694439211909930/checkpoints")
14:27:08.702 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:27:08.702 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a199ab64e05ec966270c82784e3241b1_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
14:27:08.703 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@11bb16ca
14:27:08.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.706 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.711 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.714 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23537e9a
14:27:08.717 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:08.717 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:08.718 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:08.718 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:08.718 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:08.722 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:27:08.729 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298033, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)[L],e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667),e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:08.731 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.736 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.742 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.742 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.743 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] connecting to peer
14:27:08.744 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.745 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.746 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.747 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.747 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.749 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.749 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.750 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.751 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.751 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.752 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.752 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.752 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.757 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.761 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] Successfully connected to peer
14:27:08.763 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.769 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.3
14:27:08.785 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.804 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:08.804 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.814 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x88a50668, L:/127.0.0.1:48486 - R:/127.21.234.3:42127] using SASL/PLAIN
14:27:08.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.816 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.816 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.816 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.817 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.817 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.818 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.819 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.819 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.819 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.819 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.819 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.821 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.821 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.821 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.821 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.822 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.822 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.822 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.822 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.822 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.826 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.826 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.830 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.830 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.830 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.830 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.831 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.834 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.838 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.839 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.840 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.840 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.840 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.841 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.841 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.841 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.841 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.841 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.842 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.843 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.843 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.843 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.844 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.845 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.845 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.845 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.845 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.845 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.846 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.847 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.847 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.848 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.849 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.849 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.849 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.849 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.851 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.852 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.852 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.852 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.852 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.852 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.852 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.854 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.855 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.855 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.856 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.856 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.856 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.856 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.857 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.857 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.858 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.858 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.858 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.862 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.863 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.863 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.863 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.863 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.863 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.864 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.864 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.865 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.870 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.871 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.871 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.871 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.872 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.872 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.872 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.873 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.874 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.875 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.876 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.876 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.877 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.877 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.877 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.878 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.882 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.882 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.882 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.882 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.882 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.882 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.883 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.883 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.883 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.883 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.883 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.883 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.884 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.884 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.895 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.895 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.895 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.896 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.896 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.896 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.896 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.897 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.902 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.903 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.903 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.903 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.903 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.903 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.903 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.903 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.903 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.903 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.904 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.904 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.904 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.904 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.904 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.904 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.904 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.905 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.911 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.911 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.912 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.912 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.912 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.912 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.912 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.914 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.914 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.914 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.915 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.915 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.915 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.915 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.915 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.915 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.915 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.923 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.923 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.923 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.923 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.923 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.923 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.923 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.923 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.923 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.923 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.924 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.924 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.942 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.942 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.942 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.942 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.942 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.943 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.943 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.943 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.943 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.943 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.955 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:08.955 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:08.955 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:08.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.956 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:08.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:08.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:08.956 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:08.957 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.957 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:08.957 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.957 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.957 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.957 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.958 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.958 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.958 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.958 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.972 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.972 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.972 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.973 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.973 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.973 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.973 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.983 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.983 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.983 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.984 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:08.997 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:08.997 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:08.997 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:08.997 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:08.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.998 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.998 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:08.998 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.998 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.998 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:08.998 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.015 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:09.015 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:09.015 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:09.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.015 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.016 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:09.017 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:09.017 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:09.017 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:09.017 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:09.023 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.023 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.023 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.023 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.023 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.024 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.024 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.069 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:09.070 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:09.070 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:09.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:09.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:09.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:09.070 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:09.070 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:09.070 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:09.070 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:09.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:09.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:09.070 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:09.077 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114429076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:09.089 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:27:09.090 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
14:27:09.092 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.092 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.092 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.092 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.092 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.092 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.093 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.093 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.093 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.093 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.094 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:09.094 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:09.095 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:09.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.095 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:09.105 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.105 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.105 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.106 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.106 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.106 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.107 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.138 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.139 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.139 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.140 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.158 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287252699906048001) for scanner KuduScanner(table=replication_test_table, tablet=1dd0f745fcce4200bdd168b6ce87370a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:27:09.159 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [fa4486898fe0ec3499e874328ada1f46a9bf2e808f01ee26375e98f08780d4d9]
14:27:09.159 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fa4486898fe0ec3499e874328ada1f46a9bf2e808f01ee26375e98f08780d4d9]
14:27:09.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
14:27:09.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
14:27:09.162 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fa4486898fe0ec3499e874328ada1f46a9bf2e808f01ee26375e98f08780d4d9 finished by subtask 2; deferring removal (restored in pending)
14:27:09.162 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.162 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.163 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.163 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.163 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.163 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.163 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.164 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.166 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] disconnecting while in state READY
14:27:09.167 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:09.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.186 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] handling channelInactive
14:27:09.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] cleaning up while in state READY due to: connection closed
14:27:09.186 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
14:27:09.187 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
14:27:09.259 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:09.259 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:09.259 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:09.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.260 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.260 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.260 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:09.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.312 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.312 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.312 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.313 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.313 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.313 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.313 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.313 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.326 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.327 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.327 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.327 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.327 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.327 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.328 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.328 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.328 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.328 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.335 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:09.335 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:09.335 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:09.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.336 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.336 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.336 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.336 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:09.397 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.397 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.397 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.397 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.398 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.398 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.398 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.398 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.398 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.398 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.398 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.398 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.402 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.402 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.403 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.403 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.403 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.404 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.432 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.432 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.432 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.433 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.433 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.433 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.433 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.433 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.433 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.433 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.433 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.433 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.520 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:09.521 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:09.521 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:09.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:09.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:09.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:09.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:09.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:09.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:09.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:09.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:09.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:09.522 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:09.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114429576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:09.591 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
14:27:09.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
14:27:09.592 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split fa4486898fe0ec3499e874328ada1f46a9bf2e808f01ee26375e98f08780d4d9 from pending
14:27:09.593 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 6 complete: removed 1 finished splits from enumerator state
14:27:09.633 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:09.634 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:09.634 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:09.634 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.634 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.634 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.634 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.635 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.635 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.635 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.635 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:09.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.717 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:09.717 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:09.717 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:09.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:09.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:09.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:09.717 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:27:09Z chronyd exiting
14:27:09.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.774 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:09.774 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:09.774 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:09.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:09.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:09.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:09.775 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:09.801 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.62:34807(127.19.148.62:34807)] connecting to peer
14:27:09.801 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.60:37365(127.19.148.60:37365)] connecting to peer
14:27:09.801 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.19.148.61:37523(127.19.148.61:37523)] connecting to peer
14:27:09.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:09.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.148.62:34807(127.19.148.62:34807)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:09.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.62:34807: Failed to connect to peer master-127.19.148.62:34807(127.19.148.62:34807): Connection refused: /127.19.148.62:34807
14:27:09.802 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:09.802 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.148.61:37523(127.19.148.61:37523)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:09.802 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.61:37523: Failed to connect to peer master-127.19.148.61:37523(127.19.148.61:37523): Connection refused: /127.19.148.61:37523
14:27:09.802 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:09.802 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.148.60:37365(127.19.148.60:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:09.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.148.60:37365: Failed to connect to peer master-127.19.148.60:37365(127.19.148.60:37365): Connection refused: /127.19.148.60:37365
14:27:09.802 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.148.62:34807,127.19.148.60:37365,127.19.148.61:37523; will retry
14:27:09.823 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:09.823 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:09.823 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:09.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:09.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:09.824 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.824 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:09.824 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:09.918 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:09.918 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:09.919 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:09.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:09.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:09.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:09.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:09.919 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:09.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:09.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:09.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:09.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:09.920 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:09.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:09.932 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:09.933 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:09.933 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:09.933 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.933 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.933 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:09.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.933 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:09.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:09.934 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:09.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.034 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:10.035 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:10.035 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:10.035 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.035 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.035 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.036 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.036 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.036 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:10.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114430077 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:10.097 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
14:27:10.098 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
14:27:10.172 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:10.172 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:10.172 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:10.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.173 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:10.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.222 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:10.223 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:10.223 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:10.223 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.223 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.223 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.223 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.223 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.224 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.224 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.224 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.224 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:10.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:10.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:10.281 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:10.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.282 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.282 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.282 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.282 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:10.295 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:10.295 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:10.295 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:10.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.296 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.296 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:10.317 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:10.317 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:10.318 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:10.318 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.318 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.318 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.318 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.318 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.318 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.318 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.318 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.318 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.318 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:10.342 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:10.342 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:10.342 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:10.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.342 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.344 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:10.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.475 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:10.475 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:10.475 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:10.475 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:10.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:10.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:10.476 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:10.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114430576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:10.589 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
14:27:10.590 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
14:27:10.619 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.188:46025(127.15.248.188:46025)] connecting to peer
14:27:10.619 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.190:44713(127.15.248.190:44713)] connecting to peer
14:27:10.619 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.15.248.189:37707(127.15.248.189:37707)] connecting to peer
14:27:10.619 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:10.619 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.248.188:46025(127.15.248.188:46025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:10.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:10.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.248.190:44713(127.15.248.190:44713)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:10.619 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.190:44713: Failed to connect to peer master-127.15.248.190:44713(127.15.248.190:44713): Connection refused: /127.15.248.190:44713
14:27:10.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:10.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.248.189:37707(127.15.248.189:37707)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:10.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.189:37707: Failed to connect to peer master-127.15.248.189:37707(127.15.248.189:37707): Connection refused: /127.15.248.189:37707
14:27:10.619 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.248.188:46025: Failed to connect to peer master-127.15.248.188:46025(127.15.248.188:46025): Connection refused: /127.15.248.188:46025
14:27:10.620 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.248.188:46025,127.15.248.190:44713,127.15.248.189:37707; will retry
14:27:10.654 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:10.654 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:10.654 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:10.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:10.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:10.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.655 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:10.655 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:10.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.692 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 42d6860ec9d345d6b7954cff96fde981
14:27:10.694 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2155b853f1d5f427cd7c24bae0cac9a95783aaeacd59e72d785ee7b34c6012ed'}]
14:27:10.695 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.706 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
14:27:10.707 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296033, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)[L],e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667),e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:10.718 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] connecting to peer
14:27:10.734 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] Successfully connected to peer
14:27:10.738 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.3
14:27:10.750 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:10.756 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x54cb0415, L:/127.0.0.1:48502 - R:/127.21.234.3:42127] using SASL/PLAIN
14:27:10.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.796 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.61:40633(127.21.234.61:40633)] disconnecting while in state READY
14:27:10.796 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.60:44393(127.21.234.60:44393)] disconnecting while in state READY
14:27:10.796 [DEBUG - main] (Connection.java:575) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] disconnecting while in state READY
14:27:10.797 [DEBUG - main] (Connection.java:575) [peer master-127.21.234.62:34045(127.21.234.62:34045)] disconnecting while in state READY
14:27:10.799 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.234.60:44393(127.21.234.60:44393)] handling channelInactive
14:27:10.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state READY due to: connection closed
14:27:10.799 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.234.62:34045(127.21.234.62:34045)] handling channelInactive
14:27:10.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state READY due to: connection closed
14:27:10.799 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.234.61:40633(127.21.234.61:40633)] handling channelInactive
14:27:10.799 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state READY due to: connection closed
14:27:10.803 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:10.804 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
14:27:10.804 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
14:27:10.804 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
14:27:10.806 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] handling channelInactive
14:27:10.806 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] cleaning up while in state READY due to: connection closed
14:27:10.806 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
14:27:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:10.807288 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 22775
14:27:10.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:10.857097 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 22993
14:27:10.877 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:10.877 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:10.877 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:10.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:10.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:10.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:10.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:10.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:10.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:10.878 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:10.878 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:10.878 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:10.878 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:10.890 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (d754db15cc0c9bfa72479ca905ecb22a) switched from state RESTARTING to RUNNING.
14:27:10.891 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job d754db15cc0c9bfa72479ca905ecb22a from Checkpoint 70 @ 1779114187530 for d754db15cc0c9bfa72479ca905ecb22a located at file:/tmp/junit3335103633943836326/checkpoints/d754db15cc0c9bfa72479ca905ecb22a/chk-70.
14:27:10.892 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
14:27:10.893 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:27:10.893 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to SCHEDULED.
14:27:10.894 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:27:10.894 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from SCHEDULED to DEPLOYING.
14:27:10.894 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #8) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id f182fce0edf1da65a6d97afd27db425c
14:27:10.895 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to SCHEDULED.
14:27:10.895 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:27:10.895 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from SCHEDULED to DEPLOYING.
14:27:10.895 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #8) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id d3328e0b20c8307c13567fb6051cf936
14:27:10.895 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to SCHEDULED.
14:27:10.896 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:27:10.896 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from SCHEDULED to DEPLOYING.
14:27:10.896 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #8) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 2e66b69a1b92434a74d33f57918b8903
14:27:10.897 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f182fce0edf1da65a6d97afd27db425c.
14:27:10.898 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8), deploy into slot with allocation id f182fce0edf1da65a6d97afd27db425c.
14:27:10.899 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d3328e0b20c8307c13567fb6051cf936.
14:27:10.900 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8), deploy into slot with allocation id d3328e0b20c8307c13567fb6051cf936.
14:27:10.900 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to DEPLOYING.
14:27:10.900 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) [DEPLOYING].
14:27:10.900 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 2e66b69a1b92434a74d33f57918b8903.
14:27:10.901 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8), deploy into slot with allocation id 2e66b69a1b92434a74d33f57918b8903.
14:27:10.902 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to SCHEDULED.
14:27:10.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:10.900974 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 23133
14:27:10.902 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a5408fa
14:27:10.902 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:10.902 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:27:10.902 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from SCHEDULED to DEPLOYING.
14:27:10.902 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #8) with attempt id 879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3668177f-517e-405a-935d-758299549e72 @ 127.0.0.1 (dataPort=-1) with allocation id 9d480502e0cdd9d8883744c6b05e846a
14:27:10.902 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
14:27:10.902 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
14:27:10.902 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job d754db15cc0c9bfa72479ca905ecb22a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:27:10.903 [INFO - Thread-78] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:27:10.903 [DEBUG - Thread-78] (Connection.java:575) [peer master-127.9.135.190:41023(127.9.135.190:41023)] disconnecting while in state TERMINATED
14:27:10.903 [DEBUG - Thread-78] (Connection.java:575) [peer master-127.9.135.189:37257(127.9.135.189:37257)] disconnecting while in state TERMINATED
14:27:10.903 [DEBUG - Thread-78] (Connection.java:575) [peer master-127.9.135.188:36123(127.9.135.188:36123)] disconnecting while in state TERMINATED
14:27:10.904 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 9d480502e0cdd9d8883744c6b05e846a.
14:27:10.904 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:10.904 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65413463
14:27:10.904 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8), deploy into slot with allocation id 9d480502e0cdd9d8883744c6b05e846a.
14:27:10.905 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to DEPLOYING.
14:27:10.905 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) [DEPLOYING].
14:27:10.906 [INFO - Thread-78] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:27:10.906 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.906 [INFO - Thread-78] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to DEPLOYING.
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) [DEPLOYING].
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to DEPLOYING.
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) [DEPLOYING].
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8c7cfa9
14:27:10.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27133ac1
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:27:10.907 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
14:27:10.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
14:27:10.907 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
14:27:10.909 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31911f52
14:27:10.909 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a0599a9
14:27:10.911 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@26bb1a9e
14:27:10.911 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:10.911 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3335103633943836326/checkpoints")
14:27:10.911 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
14:27:10.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (879fed5d7debbbe49a0a590b81e023af_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
14:27:10.913 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3d0965ca
14:27:10.914 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.954 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] handling channelInactive
14:27:10.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] cleaning up while in state READY due to: connection closed
14:27:10.955 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127) for tablet 1dd0f745fcce4200bdd168b6ce87370a: connection closed
14:27:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:10.955587 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 22452
14:27:10.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:10.962 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] connecting to peer
14:27:10.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:10.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] cleaning up while in state CONNECTING due to: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:10.963 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667) for tablet 1dd0f745fcce4200bdd168b6ce87370a: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:10.974 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.974 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.975 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.975 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:10.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.975 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.975 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.975 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.976 [DEBUG - Thread-78] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.976 [INFO - Thread-78] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:27:10.976 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:10.976 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.977 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:10.977 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:10.977 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:10.977 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:10.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:10.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:10.978 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.978 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.978 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:10.978 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:10.978 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.978 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)] connecting to peer
14:27:10.978 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:10.979 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:10.979 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:10.979 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:10.979 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.980 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.980 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:10.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)] cleaning up while in state CONNECTING due to: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:10.981 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065) for tablet 1dd0f745fcce4200bdd168b6ce87370a: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:10.986 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:10.986 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.986 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.986 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.986 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.986 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:10.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.987 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:10.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.987 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:10.988 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:10.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.988 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:10.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.989 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:10.989 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:10.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:10.989 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:10.989 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:10.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.989 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:10.990 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.990 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:10.990 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:10.990 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.990 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:10.990 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:10.990 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:10.990 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:10.990 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:10.994 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.234.62:34045(127.21.234.62:34045)] handling channelInactive
14:27:10.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state READY due to: connection closed
14:27:10.995 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.995 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.995 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:10.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:10.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.996 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:10.996 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:10.997 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:10.997 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:10.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:10.999 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:10.999 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.000 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.004 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.004 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:11.004654 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 22522
14:27:11.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.005 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.006 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.007 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.007 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.007 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.21.234.61:40633(127.21.234.61:40633)] Successfully connected to peer
14:27:11.007 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.015 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.017 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.018 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.018 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.018 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.018 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.021 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.021 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.21.234.60:44393(127.21.234.60:44393)] Successfully connected to peer
14:27:11.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.022 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.024 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.024 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.024 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.026 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.234.60
14:27:11.026 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.026 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.026 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.026 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.026 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.027 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.027 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.027 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.027 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.028 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.030 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.030 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.032 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
14:27:11.034 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.034 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.034 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.035 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.036 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x9ab2063c, L:/127.0.0.1:46852 - R:/127.21.234.60:44393] using SASL/PLAIN
14:27:11.038 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.039 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:27:11.040 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29709, elapsed=41), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.62:34045, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.61:40633, [6ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.62:34045: Network error: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.60:44393, [40ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.60:44393: OK, deferred=null) after lookup
14:27:11.040 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.041 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.234.61:40633(127.21.234.61:40633)] handling channelInactive
14:27:11.041 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state READY due to: connection closed
14:27:11.041 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.042 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.042 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.042 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.042 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.042 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.043 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:11.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.043 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:11.043 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:11.043 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.043 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.043 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 1dd0f745fcce4200bdd168b6ce87370a for table 'replication_test_table' with partition [<start>, <end>)
14:27:11.043 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.043 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.043 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=1dd0f745fcce4200bdd168b6ce87370a@[3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127),e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)[L],e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)]}]
14:27:11.043 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.044 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=1dd0f745fcce4200bdd168b6ce87370a, attempt=4, KuduRpc(method=Scan, tablet=1dd0f745fcce4200bdd168b6ce87370a, attempt=4, TimeoutTracker(timeout=30000, elapsed=336), Traces: [0ms] sending RPC to server 3d8f5b62daa24337b68f63e539a22a3a, [236ms] received response from server 3d8f5b62daa24337b68f63e539a22a3a: Network error: connection closed, [237ms] delaying RPC due to: Network error: connection closed, [244ms] sending RPC to server e2410af928954a1d9d406c3d02ffe411, [245ms] received response from server e2410af928954a1d9d406c3d02ffe411: Network error: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667, [245ms] delaying RPC due to: Network error: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667, [260ms] sending RPC to server e8e733c2e2b4440b94f05b991bb5407f, [263ms] received response from server e8e733c2e2b4440b94f05b991bb5407f: Network error: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065, [263ms] delaying RPC due to: Network error: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065, [281ms] refreshing cache from master, [281ms] Sub RPC GetTableLocations: refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.62:34045, [286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.61:40633, [287ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.62:34045: Network error: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.234.60:44393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.234.60:44393: OK, [322ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.234.60:44393, [325ms] Sub RPC GetTableLocations: received response from server master-127.21.234.60:44393: OK, deferred=Deferred@1950664043(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup
14:27:11.044 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] connecting to peer
14:27:11.044 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.045 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127): Connection refused: /127.21.234.3:42127
14:27:11.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127)] cleaning up while in state CONNECTING due to: Failed to connect to peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127): Connection refused: /127.21.234.3:42127
14:27:11.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.045 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127) for tablet 1dd0f745fcce4200bdd168b6ce87370a: Failed to connect to peer 3d8f5b62daa24337b68f63e539a22a3a(127.21.234.3:42127): Connection refused: /127.21.234.3:42127
14:27:11.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.045 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.045 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.046 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.046 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:11.046 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.21.234.61:40633(127.21.234.61:40633)] unexpected exception from downstream on [id: 0x4714baaa, L:/127.0.0.1:57330 - R:/127.21.234.61:40633]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:11.047 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state NEGOTIATING due to: [peer master-127.21.234.61:40633(127.21.234.61:40633)] unexpected exception from downstream on [id: 0x4714baaa, L:/127.0.0.1:57330 - R:/127.21.234.61:40633]
14:27:11.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: [peer master-127.21.234.61:40633(127.21.234.61:40633)] unexpected exception from downstream on [id: 0x4714baaa, L:/127.0.0.1:57330 - R:/127.21.234.61:40633]
14:27:11.047 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.21.234.61:40633(127.21.234.61:40633)] handling channelInactive
14:27:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:27:11.047091 22440 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskHAyHVV/build/tsan/bin/kudu with pid 22651
14:27:11.048 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.048 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.052 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.052 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.055 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.055 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.055 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.056 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.057 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.057 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.057 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.058 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.058 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.058 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.058 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.058 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] connecting to peer
14:27:11.059 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.059 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.059 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:11.059 [DEBUG - kudu-nio-7] (Connection.java:709) [peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667)] cleaning up while in state CONNECTING due to: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:11.059 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.059 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667) for tablet 1dd0f745fcce4200bdd168b6ce87370a: Failed to connect to peer e2410af928954a1d9d406c3d02ffe411(127.21.234.2:46667): Connection refused: /127.21.234.2:46667
14:27:11.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.059 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.059 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.059 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.059 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.060 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.060 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.060 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.060 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.068 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.068 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.068 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.068 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.068 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.068 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.068 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.068 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.068 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.068 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.074 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.075 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.075 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.075 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.075 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.075 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.075 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.077 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.077 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.077 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.077 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114431076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:11.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.077 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.077 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.078 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.080 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.080 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.081 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.081 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.081 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.081 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.081 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.081 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.081 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.081 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.082 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.082 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.082 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.082 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.21.234.60:44393(127.21.234.60:44393)] handling channelInactive
14:27:11.082 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.234.60:44393(127.21.234.60:44393)] handling channelInactive
14:27:11.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state READY due to: connection closed
14:27:11.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state READY due to: connection closed
14:27:11.082 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.082 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.082 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.082 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.083 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.082 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.083 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.086 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
14:27:11.087 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.087 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.088 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.088 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.088 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.088 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
14:27:11.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.095 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.097 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.097 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.097 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.097 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.098 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.099 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)] connecting to peer
14:27:11.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:11.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065)] cleaning up while in state CONNECTING due to: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:11.099 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065) for tablet 1dd0f745fcce4200bdd168b6ce87370a: Failed to connect to peer e8e733c2e2b4440b94f05b991bb5407f(127.21.234.1:36065): Connection refused: /127.21.234.1:36065
14:27:11.100 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.100 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.100 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.100 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.100 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.100 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.100 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.100 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.100 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.100 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.100 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.100 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.100 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.108 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.108 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.108 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.108 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.108 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.108 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.108 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.108 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.108 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.108 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.114 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:11.115 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:11.115 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:11.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.115 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.115 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.115 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.115 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.115 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:11.115 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.116 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.116 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.116 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.116 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.116 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.118 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.118 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.118 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.118 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.119 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.120 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.120 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.121 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.121 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.121 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.121 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.121 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.121 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.121 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.121 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.135 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.135 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.135 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.136 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.139 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.139 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.139 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.139 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.139 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.139 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.139 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.142 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.147 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.147 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.148 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.148 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.148 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.148 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.148 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.177 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.177 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.177 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.177 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.177 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.177 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.178 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.178 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.178 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.178 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.179 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.179 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.21.234.60:44393(127.21.234.60:44393) for tablet Kudu Master: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.180 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.180 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.180 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.181 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.181 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.181 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.181 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.181 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.181 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.181 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.197 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.197 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.197 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.197 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.197 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.197 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.197 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.197 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.197 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.197 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.197 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.197 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.199 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.199 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.199 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.199 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.199 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.199 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.199 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.199 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.200 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.200 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.200 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.200 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.200 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.124:35565(127.13.91.124:35565)] connecting to peer
14:27:11.200 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.126:39961(127.13.91.126:39961)] connecting to peer
14:27:11.200 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.13.91.125:45957(127.13.91.125:45957)] connecting to peer
14:27:11.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:11.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.91.124:35565(127.13.91.124:35565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:11.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.124:35565: Failed to connect to peer master-127.13.91.124:35565(127.13.91.124:35565): Connection refused: /127.13.91.124:35565
14:27:11.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:11.201 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.91.126:39961(127.13.91.126:39961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:11.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.126:39961: Failed to connect to peer master-127.13.91.126:39961(127.13.91.126:39961): Connection refused: /127.13.91.126:39961
14:27:11.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:11.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.91.125:45957(127.13.91.125:45957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:11.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.91.125:45957: Failed to connect to peer master-127.13.91.125:45957(127.13.91.125:45957): Connection refused: /127.13.91.125:45957
14:27:11.201 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.91.124:35565,127.13.91.126:39961,127.13.91.125:45957; will retry
14:27:11.219 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.219 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.219 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.219 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.219 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.219 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.219 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.219 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.238 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.238 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.239 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.239 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.239 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.239 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.239 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.239 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.239 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.239 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.239 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.247 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.247 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.247 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.247 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.247 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.248 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.248 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.248 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.248 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.259 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.259 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.259 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.259 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.259 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.259 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.259 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.259 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.259 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.259 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.260 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.260 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.260 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.260 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.275 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.275 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.275 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.275 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.276 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.277 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.277 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.277 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.277 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.277 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.277 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.277 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.280 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.280 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.280 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.281 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.281 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.297 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.299 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.299 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.299 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.299 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.299 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.299 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.299 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.299 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.299 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.300 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.300 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.308 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.308 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.308 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.308 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.308 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.308 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.308 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.308 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.338 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.339 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.339 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.339 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.339 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.339 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.339 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.339 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.362 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:11.363 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:11.363 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:11.363 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.363 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.363 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.363 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:11.375 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.375 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.375 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.375 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.375 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.375 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.375 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.375 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.375 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.401 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.401 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.401 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.401 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.402 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.419 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.419 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.419 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.419 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.419 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.419 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.420 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.438 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.438 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.438 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.439 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.439 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.439 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.439 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.439 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.439 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.446 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:11.446 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:11.447 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:11.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.447 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.447 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.447 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.447 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:11.451 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:11.452 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:11.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.452 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:11.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.452 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.452 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.452 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.452 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.452 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.452 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.452 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:11.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.478 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.478 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.478 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.479 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.479 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.479 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.479 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.497 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.497 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.497 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.497 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.497 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.497 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.498 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.498 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.498 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.498 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.498 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.498 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.498 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.529 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:11.529 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:11.530 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:11.530 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.530 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.530 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:11.530 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:11.530 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:11.530 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:11.536 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:11.536 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:11.536 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:11.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.536 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.537 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.537 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:11.547 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:11.547 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:11.547 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:11.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.548 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:11.548 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.548 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:11.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:11.548 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:11.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114431576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:11.585 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
14:27:11.586 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
14:27:11.615 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (eb69507117e6ffaf90d8bea22e591f35) switched from state RESTARTING to RUNNING.
14:27:11.616 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job eb69507117e6ffaf90d8bea22e591f35 from Checkpoint 70 @ 1779114231581 for eb69507117e6ffaf90d8bea22e591f35 located at file:/tmp/junit16754294086695337937/checkpoints/eb69507117e6ffaf90d8bea22e591f35/chk-70.
14:27:11.616 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
14:27:11.616 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
14:27:11.617 [INFO - Thread-79] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
14:27:11.617 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
14:27:11.617 [DEBUG - Thread-79] (Connection.java:575) [peer master-127.11.83.188:44337(127.11.83.188:44337)] disconnecting while in state TERMINATED
14:27:11.617 [DEBUG - Thread-79] (Connection.java:575) [peer master-127.11.83.190:41547(127.11.83.190:41547)] disconnecting while in state TERMINATED
14:27:11.618 [DEBUG - Thread-79] (Connection.java:575) [peer master-127.11.83.189:34071(127.11.83.189:34071)] disconnecting while in state TERMINATED
14:27:11.618 [DEBUG - Thread-79] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:27:11.618 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
14:27:11.618 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 869b6a91e486470c39aab2d9a4839c92
14:27:11.618 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
14:27:11.619 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
14:27:11.619 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
14:27:11.619 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id a39e5fcb8c2557072005ea690bf35b6c
14:27:11.620 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
14:27:11.620 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 869b6a91e486470c39aab2d9a4839c92.
14:27:11.620 [INFO - Thread-79] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
14:27:11.620 [INFO - Thread-79] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
14:27:11.620 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
14:27:11.621 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 869b6a91e486470c39aab2d9a4839c92.
14:27:11.622 [DEBUG - Thread-79] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:11.622 [INFO - Thread-79] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
14:27:11.622 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
14:27:11.622 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a39e5fcb8c2557072005ea690bf35b6c.
14:27:11.622 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
14:27:11.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@688b3572
14:27:11.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:11.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:27:11.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
14:27:11.623 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id a39e5fcb8c2557072005ea690bf35b6c.
14:27:11.624 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:27:11.624 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
14:27:11.624 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 1f10924a53a30da094cc2390f240981f
14:27:11.624 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
14:27:11.625 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17e6952f
14:27:11.625 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job eb69507117e6ffaf90d8bea22e591f35: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
14:27:11.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
14:27:11.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 93468478-99eb-4785-93a0-96daa5eb43cb @ 127.0.0.1 (dataPort=-1) with allocation id 3a331bef465918e8cbe675a7c5e83a3b
14:27:11.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
14:27:11.626 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:11.634 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:11.634 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:11.634 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:11.634 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
14:27:11.635 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1f10924a53a30da094cc2390f240981f.
14:27:11.636 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 1f10924a53a30da094cc2390f240981f.
14:27:11.636 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
14:27:11.636 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
14:27:11.636 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3585c92e
14:27:11.636 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:11.637 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:27:11.637 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
14:27:11.637 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
14:27:11.638 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.639 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.639 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.639 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.639 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.639 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.640 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ae0fadd
14:27:11.642 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:11.643 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3a331bef465918e8cbe675a7c5e83a3b.
14:27:11.643 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.644 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id 3a331bef465918e8cbe675a7c5e83a3b.
14:27:11.644 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
14:27:11.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
14:27:11.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b9e3266
14:27:11.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:11.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:27:11.646 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
14:27:11.646 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.646 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
14:27:11.647 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d9080d0
14:27:11.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.650 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:11.651 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
14:27:11.651 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
14:27:11.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1032d57
14:27:11.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
14:27:11.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16754294086695337937/checkpoints")
14:27:11.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
14:27:11.652 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (7912f532f84f26a1b5a55178e2daf261_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
14:27:11.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@67abb153
14:27:11.654 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.655 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:27:11.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.656 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.656 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.656 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.657 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.657 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.658 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.658 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.658 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.658 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.658 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.658 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.658 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.662 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.662 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.663 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.663 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.663 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.663 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.663 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.663 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.663 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.664 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.664 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.664 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.664 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.667 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.667 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.670 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.670 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.670 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.670 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.671 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.671 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.672 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.672 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.672 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.672 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.673 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.673 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.673 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.673 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.673 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.673 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.673 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.677 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 77d052e6e51b5ae35525074f80512696 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 77d052e6e51b5ae35525074f80512696 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.678 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.679 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.679 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.680 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.682 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.683 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.683 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.683 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.683 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.683 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.684 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.684 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.684 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.684 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.684 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.684 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.684 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.684 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.684 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.685 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.685 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.685 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.687 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.687 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.687 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.687 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.687 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.687 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.688 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.688 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.688 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.689 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.689 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.689 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.699 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.699 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.700 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.700 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.700 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.700 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.702 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.703 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.703 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.704 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.704 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.704 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.704 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.705 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.705 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.705 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.706 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.706 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.706 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.706 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.706 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.706 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.706 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.707 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.707 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.707 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.707 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.707 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.707 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.707 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.707 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.707 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.708 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.708 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.708 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.708 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.708 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.708 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.709 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.718 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.718 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.718 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.718 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.718 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.718 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.718 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.723 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.723 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.723 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.723 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.723 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.723 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.723 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.723 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.723 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.723 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.723 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.723 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.724 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.724 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.724 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.724 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.724 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.724 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.726 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.726 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.726 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.726 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.727 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.728 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.728 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.728 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.728 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.728 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.729 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.729 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.729 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.729 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.729 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.729 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.729 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.729 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.731 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:11.732 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:11.732 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:11.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.732 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.732 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.732 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.732 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.732 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:11.738 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.738 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.738 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.739 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.739 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.739 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.739 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.739 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.739 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.739 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.742 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.742 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.742 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.743 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.744 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.744 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.744 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.744 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.744 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.744 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.744 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.744 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.744 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.744 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.763 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.763 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.763 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.763 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.763 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.763 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.763 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.763 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.763 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.766 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.767 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.767 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.767 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.767 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.767 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.767 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.767 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.768 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.768 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.768 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.768 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.768 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.768 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.769 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.769 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.769 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.778 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.778 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.778 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.778 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.778 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.778 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.778 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.779 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.782 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.782 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.782 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.782 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.782 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.782 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.783 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.783 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.783 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.783 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.783 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.783 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.783 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.784 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.784 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.784 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.784 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.786 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.786 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.786 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.786 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.787 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.787 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.788 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.788 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.788 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.788 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.788 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.789 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.789 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.789 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.789 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.796 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:11.796 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:11.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.797 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:11.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:11.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:11.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:11.797 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:11.797 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.799 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.799 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.799 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.799 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.823 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.823 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.823 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.824 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.838 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.839 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.839 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.839 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.839 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.839 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.844 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.844 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.844 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.844 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.844 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.844 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.844 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.844 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.844 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.844 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.844 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.858 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.859 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.859 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.859 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.877 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:11.877 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:11.877 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:11.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:11.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.878 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.878 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:11.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:11.878 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:11.879 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:11.879 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:11.879 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26367), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [27ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [53ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [94ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [861ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1742ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6161ms] refreshing cache from master, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6162ms] too many traces: truncated at 100 traces, deferred=Deferred@1901127559(state=PENDING, result=null, callback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403), errback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403)))
14:27:11.879 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.879 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.879 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.879 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.879 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:11.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:11.879 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:11.880 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.880 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.880 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:11.880 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:11.880 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
14:27:11.880 [WARN - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26367), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [27ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [53ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [94ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [861ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1742ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6161ms] refreshing cache from master, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6162ms] too many traces: truncated at 100 traces, deferred=Deferred@1901127559(state=PENDING, result=null, callback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403), errback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:11.881 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
14:27:11.884 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
14:27:11.885 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED on 21691bb2-e877-4288-9642-b4c1288bf103 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26367), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [13ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [14ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [18ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [18ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [27ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [53ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [65ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [67ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [94ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [94ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [101ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [126ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [126ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [221ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [441ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [861ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [861ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [1742ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.61:38507: Network error: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.62:33795: Network error: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.33.60:39347: Network error: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [3102ms] delaying RPC due to: Service unavailable: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347, [6161ms] refreshing cache from master, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.61:38507, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.60:39347, [6161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.33.62:33795, [6162ms] too many traces: truncated at 100 traces, deferred=Deferred@1901127559(state=PENDING, result=null, callback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403), errback=(continuation of Deferred@132406208 after retry RPC after error@1929651727) -> (continuation of Deferred@1303824165 after retry RPC after error@1001156043) -> (continuation of Deferred@515054373 after retry RPC after error@1289052834) -> (continuation of Deferred@924916722 after retry RPC after error@1866201832) -> (continuation of Deferred@1767353881 after retry RPC after error@250614243) -> (continuation of Deferred@833709380 after retry RPC after error@32318752) -> (continuation of Deferred@1428055138 after retry RPC after error@1542391851) -> (continuation of Deferred@1632558423 after retry RPC after error@165818491) -> (continuation of Deferred@804878417 after retry RPC after error@208962517) -> (continuation of Deferred@466043753 after retry RPC after error@62835074) -> (continuation of Deferred@1734410836 after retry RPC after error@1336106822) -> (continuation of Deferred@1851687376 after retry RPC after error@458860352) -> (continuation of Deferred@1959093725 after retry RPC after error@566844780) -> (continuation of Deferred@990054532 after retry RPC after error@1832311555) -> (continuation of Deferred@847421685 after retry RPC after error@1506519540) -> (continuation of Deferred@2049957217 after retry RPC after error@563806180) -> (continuation of Deferred@112752170 after retry RPC after error@45673216) -> (continuation of Deferred@108591843 after retry RPC after error@1894465559) -> (continuation of Deferred@900165894 after retry RPC after error@1887595609) -> (continuation of Deferred@837562184 after retry RPC after error@464333466) -> (continuation of Deferred@353126312 after retry RPC after error@1989087732) -> (continuation of Deferred@650769922 after retry RPC after error@1413673403)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.33.62:33795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
14:27:11.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
14:27:11.887 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task cbc4c8bc6af3ce5fc73a888f368571e5_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
14:27:11.887 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (77d052e6e51b5ae35525074f80512696) switched from state RUNNING to RESTARTING.
14:27:11.887 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 77d052e6e51b5ae35525074f80512696: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
14:27:11.897 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:11.897 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:11.897 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:11.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:11.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:11.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:11.898 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:11.903 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.903 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.903 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.904 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.906 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.906 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.906 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.906 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.906 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.907 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.907 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.908 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.908 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.908 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.908 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.909 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:11.918 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.918 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.918 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.918 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.919 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.943 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.944 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.944 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.944 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.944 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.944 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.944 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.944 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.944 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.944 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.946 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:11.947 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:11.947 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:11.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:11.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:11.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:11.947 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:11.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:11.988 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:11.988 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:11.988 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:11.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:11.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.989 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:11.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:11.989 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:12.076 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114432076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:12.088 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
14:27:12.089 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
14:27:12.118 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.118 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.118 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.118 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.118 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.118 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.118 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.118 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.118 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.119 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.124 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.124 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.124 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.124 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.124 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.124 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.124 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.124 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.124 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.149 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.168 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:12.168 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:12.168 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:12.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:12.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:12.168 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:12.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:12.168 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:12.168 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:12.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:12.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:12.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:12.169 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:12.215 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:12.215 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:12.215 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:12.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.215 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.215 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:12.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:27:12Z chronyd exiting
14:27:12.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.263 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.263 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.263 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.263 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.263 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.263 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.263 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.263 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.287 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.287 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.287 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.287 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.297 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.300 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:12.300 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:12.300 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:12.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.300 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.300 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.301 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:12.379 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:12.379 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:12.379 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:12.379 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:12.379 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:12.379 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:12.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:12.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:12.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:12.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:12.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:12.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:12.380 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:12.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.428 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:12.428 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:12.428 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:12.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.429 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:12.440 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:12.440 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:12.441 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:12.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.441 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.441 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.441 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:12.458 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.474 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.62:37019(127.17.128.62:37019)] connecting to peer
14:27:12.475 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.61:34199(127.17.128.61:34199)] connecting to peer
14:27:12.475 [DEBUG - pool-532-thread-1] (Connection.java:748) [peer master-127.17.128.60:42293(127.17.128.60:42293)] connecting to peer
14:27:12.475 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:12.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:12.475 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.128.62:37019(127.17.128.62:37019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:12.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:12.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.128.61:34199(127.17.128.61:34199)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:12.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.128.60:42293(127.17.128.60:42293)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:12.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.61:34199: Failed to connect to peer master-127.17.128.61:34199(127.17.128.61:34199): Connection refused: /127.17.128.61:34199
14:27:12.475 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.62:37019: Failed to connect to peer master-127.17.128.62:37019(127.17.128.62:37019): Connection refused: /127.17.128.62:37019
14:27:12.475 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.128.60:42293: Failed to connect to peer master-127.17.128.60:42293(127.17.128.60:42293): Connection refused: /127.17.128.60:42293
14:27:12.475 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.128.62:37019,127.17.128.61:34199,127.17.128.60:42293; will retry
14:27:12.524 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.524 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.524 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.524 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.524 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.524 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.524 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.524 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.524 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.524 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.558 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:12.558 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:12.558 [DEBUG - pool-564-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:12.559 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.559 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.559 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.559 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.559 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:12.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:12.559 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.559 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.559 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:12.559 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:12.560 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:12.561 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:12.561 [DEBUG - pool-549-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:12.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.561 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.561 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.561 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.561 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.561 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.561 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.561 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:12.562 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:12.563 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:12.563 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.563 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:12.563 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.563 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.563 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.563 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.563 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.563 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.563 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.563 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:12.576 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114432576 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:12.583 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:27:12.584 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
14:27:12.622 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:12.622 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:12.622 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:12.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.623 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:12.649 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.705 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:12.706 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:12.706 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:12.706 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.706 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.706 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.706 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.706 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.706 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.706 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.706 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.706 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.706 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:12.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.789 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:12.790 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:12.790 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:12.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:12.790 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:12.790 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.790 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.790 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:12.790 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:12.797 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.799 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:12.799 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:12.799 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:12.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:12.799 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:12.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:12.800 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:12.800 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:12.800 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:12.800 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:12.800 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:12.800 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:12.800 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:12.834 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:12.834 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:12.834 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:12.834 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.834 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.834 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.834 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.835 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.835 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:12.856 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.254:35143(127.18.72.254:35143)] connecting to peer
14:27:12.857 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.252:44649(127.18.72.252:44649)] connecting to peer
14:27:12.857 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.18.72.253:45261(127.18.72.253:45261)] connecting to peer
14:27:12.857 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.857 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.18.72.254:35143(127.18.72.254:35143)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.857 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.254:35143: Failed to connect to peer master-127.18.72.254:35143(127.18.72.254:35143): Connection refused: /127.18.72.254:35143
14:27:12.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.857 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.18.72.253:45261(127.18.72.253:45261)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.857 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.18.72.252:44649(127.18.72.252:44649)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.253:45261: Failed to connect to peer master-127.18.72.253:45261(127.18.72.253:45261): Connection refused: /127.18.72.253:45261
14:27:12.857 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.18.72.252:44649: Failed to connect to peer master-127.18.72.252:44649(127.18.72.252:44649): Connection refused: /127.18.72.252:44649
14:27:12.857 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.18.72.254:35143,127.18.72.252:44649,127.18.72.253:45261; will retry
14:27:12.868 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.190:41547(127.11.83.190:41547)] connecting to peer
14:27:12.868 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.188:44337(127.11.83.188:44337)] connecting to peer
14:27:12.868 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.11.83.189:34071(127.11.83.189:34071)] connecting to peer
14:27:12.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.83.188:44337(127.11.83.188:44337)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.83.190:41547(127.11.83.190:41547)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.83.189:34071(127.11.83.189:34071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.188:44337: Failed to connect to peer master-127.11.83.188:44337(127.11.83.188:44337): Connection refused: /127.11.83.188:44337
14:27:12.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.190:41547: Failed to connect to peer master-127.11.83.190:41547(127.11.83.190:41547): Connection refused: /127.11.83.190:41547
14:27:12.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.83.189:34071: Failed to connect to peer master-127.11.83.189:34071(127.11.83.189:34071): Connection refused: /127.11.83.189:34071
14:27:12.869 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.83.190:41547,127.11.83.188:44337,127.11.83.189:34071; will retry
14:27:12.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2c28d6d49adcc0d598680955c9f9304b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2c28d6d49adcc0d598680955c9f9304b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:12.937 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:12.938 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:12.938 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:12.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.938 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:12.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:12.938 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.938 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:12.938 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:12.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4459c5bc8e668403214dd967e9f85899 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4459c5bc8e668403214dd967e9f85899 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:13.015 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:13.015 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:13.015 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:13.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.015 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.015 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.016 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:13.018 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:13.018 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:13.018 [DEBUG - pool-551-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:13.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.019 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.019 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.019 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:13.027 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.188:36123(127.9.135.188:36123)] connecting to peer
14:27:13.028 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.189:37257(127.9.135.189:37257)] connecting to peer
14:27:13.028 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.9.135.190:41023(127.9.135.190:41023)] connecting to peer
14:27:13.028 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:13.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.135.188:36123(127.9.135.188:36123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:13.028 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.188:36123: Failed to connect to peer master-127.9.135.188:36123(127.9.135.188:36123): Connection refused: /127.9.135.188:36123
14:27:13.028 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:13.028 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.135.189:37257(127.9.135.189:37257)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:13.028 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.189:37257: Failed to connect to peer master-127.9.135.189:37257(127.9.135.189:37257): Connection refused: /127.9.135.189:37257
14:27:13.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:13.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.135.190:41023(127.9.135.190:41023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:13.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.135.190:41023: Failed to connect to peer master-127.9.135.190:41023(127.9.135.190:41023): Connection refused: /127.9.135.190:41023
14:27:13.028 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.135.188:36123,127.9.135.189:37257,127.9.135.190:41023; will retry
14:27:13.046 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:13.046 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:13.047 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:13.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.047 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.047 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.047 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.047 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:13.076 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779114433076 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf.
14:27:13.083 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 6a397d5027a7b18c1b9ef5e0a2e2b4bf (1965 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
14:27:13.084 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
14:27:13.103 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:13.103 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:13.103 [DEBUG - pool-562-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:13.103 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.104 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:13.119 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.62:34045(127.21.234.62:34045)] connecting to peer
14:27:13.119 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.61:40633(127.21.234.61:40633)] connecting to peer
14:27:13.119 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.21.234.60:44393(127.21.234.60:44393)] connecting to peer
14:27:13.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:13.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.234.62:34045(127.21.234.62:34045)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:13.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.62:34045: Failed to connect to peer master-127.21.234.62:34045(127.21.234.62:34045): Connection refused: /127.21.234.62:34045
14:27:13.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:13.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:13.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.234.61:40633(127.21.234.61:40633)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:13.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.234.60:44393(127.21.234.60:44393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:13.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.60:44393: Failed to connect to peer master-127.21.234.60:44393(127.21.234.60:44393): Connection refused: /127.21.234.60:44393
14:27:13.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.234.61:40633: Failed to connect to peer master-127.21.234.61:40633(127.21.234.61:40633): Connection refused: /127.21.234.61:40633
14:27:13.119 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.234.62:34045,127.21.234.61:40633,127.21.234.60:44393; will retry
14:27:13.144 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:13.144 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:13.144 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:13.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.144 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:13.149 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job eb69507117e6ffaf90d8bea22e591f35 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job eb69507117e6ffaf90d8bea22e591f35 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
14:27:13.183 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.60:37961(127.12.11.60:37961)] connecting to peer
14:27:13.183 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.61:45967(127.12.11.61:45967)] connecting to peer
14:27:13.184 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.12.11.62:39875(127.12.11.62:39875)] connecting to peer
14:27:13.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.11.60:37961(127.12.11.60:37961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.60:37961: Failed to connect to peer master-127.12.11.60:37961(127.12.11.60:37961): Connection refused: /127.12.11.60:37961
14:27:13.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.11.61:45967(127.12.11.61:45967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.11.62:39875(127.12.11.62:39875)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.62:39875: Failed to connect to peer master-127.12.11.62:39875(127.12.11.62:39875): Connection refused: /127.12.11.62:39875
14:27:13.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.11.61:45967: Failed to connect to peer master-127.12.11.61:45967(127.12.11.61:45967): Connection refused: /127.12.11.61:45967
14:27:13.184 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.11.60:37961,127.12.11.61:45967,127.12.11.62:39875; will retry
14:27:13.234 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.62:34681(127.10.60.62:34681)] connecting to peer
14:27:13.235 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.61:42317(127.10.60.61:42317)] connecting to peer
14:27:13.235 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.10.60.60:46387(127.10.60.60:46387)] connecting to peer
14:27:13.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.60.62:34681(127.10.60.62:34681)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.62:34681: Failed to connect to peer master-127.10.60.62:34681(127.10.60.62:34681): Connection refused: /127.10.60.62:34681
14:27:13.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.60.61:42317(127.10.60.61:42317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.60.60:46387(127.10.60.60:46387)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.61:42317: Failed to connect to peer master-127.10.60.61:42317(127.10.60.61:42317): Connection refused: /127.10.60.61:42317
14:27:13.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.60.60:46387: Failed to connect to peer master-127.10.60.60:46387(127.10.60.60:46387): Connection refused: /127.10.60.60:46387
14:27:13.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.10.60.62:34681,127.10.60.61:42317,127.10.60.60:46387; will retry
14:27:13.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 01c353b3dfaac48d363fa91db2a11301 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 01c353b3dfaac48d363fa91db2a11301 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..

14:27:13.298 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job d754db15cc0c9bfa72479ca905ecb22a since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job d754db15cc0c9bfa72479ca905ecb22a is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
Time: 317.988

OK (7 tests)

14:27:13.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.61:38507(127.14.33.61:38507)] connecting to peer
14:27:13.299 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
14:27:13.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.60:39347(127.14.33.60:39347)] connecting to peer
14:27:13.299 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.14.33.62:33795(127.14.33.62:33795)] connecting to peer
14:27:13.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.300 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.33.61:38507(127.14.33.61:38507)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.300 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.61:38507: Failed to connect to peer master-127.14.33.61:38507(127.14.33.61:38507): Connection refused: /127.14.33.61:38507
14:27:13.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.33.60:39347(127.14.33.60:39347)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.300 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:35473
14:27:13.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.60:39347: Failed to connect to peer master-127.14.33.60:39347(127.14.33.60:39347): Connection refused: /127.14.33.60:39347
14:27:13.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.33.62:33795(127.14.33.62:33795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.300 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.33.62:33795: Failed to connect to peer master-127.14.33.62:33795(127.14.33.62:33795): Connection refused: /127.14.33.62:33795
14:27:13.300 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.33.61:38507,127.14.33.60:39347,127.14.33.62:33795; will retry
14:27:13.301 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
14:27:13.302 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:37215
14:27:13.303 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-a8581fea-c5e4-42c3-b60a-b0c0e441d098
14:27:13.310 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-4ac1ec40-441e-4fe8-b166-842e8b67fa1d
14:27:13.310 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
14:27:13.311 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-ae26bfc7-4784-4be4-8083-5aae75140f80
14:27:13.312 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-cccc8634-f615-4dee-a943-6196b1a662d0
14:27:13.312 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
14:27:13.313 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
14:27:13.313 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
14:27:13.313 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
14:27:13.314 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-d8d644c9-ad39-49a1-b1bc-302865f51660
14:27:13.314 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-073fec32-eb83-4e4d-9f39-4f5dc1bd6b80
14:27:13.315 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-f11dc725-6153-41d0-b793-fc52f27c2bfd
14:27:13.315 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-438dd839-8c88-482e-9830-a6fb56166655
14:27:13.315 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.125:34309(127.20.103.125:34309)] connecting to peer
14:27:13.315 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
14:27:13.315 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.124:41795(127.20.103.124:41795)] connecting to peer
14:27:13.315 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.20.103.126:39327(127.20.103.126:39327)] connecting to peer
14:27:13.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:13.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.20.103.125:34309(127.20.103.125:34309)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:13.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.125:34309: Failed to connect to peer master-127.20.103.125:34309(127.20.103.125:34309): Connection refused: /127.20.103.125:34309
14:27:13.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:13.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:13.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.20.103.126:39327(127.20.103.126:39327)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:13.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.20.103.124:41795(127.20.103.124:41795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:13.315 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
14:27:13.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.126:39327: Failed to connect to peer master-127.20.103.126:39327(127.20.103.126:39327): Connection refused: /127.20.103.126:39327
14:27:13.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.20.103.124:41795: Failed to connect to peer master-127.20.103.124:41795(127.20.103.124:41795): Connection refused: /127.20.103.124:41795
14:27:13.316 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.20.103.125:34309,127.20.103.124:41795,127.20.103.126:39327; will retry
14:27:13.316 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
14:27:13.316 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
14:27:13.316 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
